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ABSTRACT 


The  change  point  of  a  function  is  defined  to  be  the 
point  (assumed  unique)  that  minimizt s  or  maximizes  the 
function. 

Fixeu  and  narrow  "window''  c.vt  imtors  are  proposed  and 

studied  for  the  change  point  of  the  generalized  failure  rate 

f  (x) 

function  r(x)  ■ - - — L -  where  F  and  G  are  distribu- 

g[G_1F(x)] 

tions  with  densities  f  and  g  ,  respectively.  For  a  given 

G  and  an  unknown  F  ,  the  change  point  is  estimated  by  (1) 

estimating  r(x)  ,  relaxing  the  assumption  of  complete 

sample;  and  (2)  minimizing  the  estimator  of  r(x)  over 

x  e  G  with  ft  a  grid  on  .  The  estimators  are 

n  n 

shown  to  be  consistent  and  their  asymptotic  distributions 
are  derived  using  theorems  on  the  convergence  of  distribu¬ 
tions  of  stochastic  processes.  When  G  is  the  uniform 
distribution  on  [0,1]  ,  estimation  of  the  mode  of  a  density 
falls  out  as  a  special  case;  and,  by  virtue  of  (1)  and  (2), 
the  asymptotic  results  are  shown  to  hold  in  this  case  under 
conditions  more  general  than  assumed  by  Chernoff  (1964)  and 
Venter  (1967).  Estimators  have  also  been  proposed  when 
r(x)  is  known  to  be  U-shaped. 

A  computer  program  has  been  written  in  FORTRAN  IV  to 
obtain  estimates  of  the  change  point  of  density  and  failure 
rate  functions.  Several  numerical  investigations  have 
indicated  the  superiority  of  a  particular  estimator  in  the 


case  of  small  samples. 
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CHAPTER  I 


INTRODUCTION 


1.  Literature  Review 

Estimators  for  the  mode  of  a  probability  density  function  have  been 
considered  by  Chernoff  [5],  Parzen  [12]  and  Venter  [18],  In  each  case,  it 
has  been  assumed  that  there  is  a  sample  of  n  independent  observations 
from  a  distribution  F  ,  the  mode  of  whose  density  we  wish  to  estimate. 
Consistency  and  asymptotic  distribution  of  the  estimators  have  been  dealt 
with  in  each  of  the  above  papers.  The  companion  problems  of  estimating 
probability  density  and  failure  rate  functions  have  been  considered  by  many 
authors.  See,  for  example,  Bray,  Crawford  and  Proschan  [4],  Parzen  [12], 
Rao  [13].  Estimation  of  the  monotone  generalized  failure  rate  function 
(defined  in  Section  3)  has  recently  been  dealt  with  by  Barlow  and  van  Zwet 
[1,2],  which  subsumes  the  cases  of  estimating  monotone  density  and  failure 
rate  functions. 

2.  The  Estimation  Problem 
Definition ; 

The  change  point  of  a  function  is  the  point  (assumed  unique)  at  which 
the  function  attains  its  global  minimum  (or  its  global  maximum). 

This  thesis  formulates  estimation  of  the  mode  of  a  probability  density 
function  and  of  the  point  which  minimizes  a  failure  rate  function,  as  a 
special  case  of  a  larger  class  of  problems  viz.  estimation  of  the  change 
point  of  the  generalized  failure  rate  function.  The  second  generalization 
is  the  choice  of  grid  points  for  observing  and/or  analyzing  the  data. 
Whereas  both  Chernoff  and  Venter  assume  a  complete  sample  and  use  a  grid 
based  on  order  statistics  for  analyzing  the  data,  it  is  shown  that  the 
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asymptotic  results  are  not  changed  by  choosing  wider  grids  -  an  important 
fact  for  implementing  the  estimation  procedure  in  real  life. 


3.  Notation  and  Preliminaries 

Let  F  be  the  unknown  distribution  function,  with  density  f  ,  from 
which  the  sample  of  observations  is  drawn  and  G  be  a  known  distribution 
function  with  density  g  .  Let  s^  ,  f  ,,  be  the  left  and  right  end  points 
of  the  support  of  F  . 

We  define  two  transformations  $p(x)  and  ♦p(y)  as  follows: 

F‘\y) 

(3.1)  *F(x)  -  G"1F(x)  ;  *p(y)  -  I  g[G_1F(u)]du  0  <  y  .<  1  . 

•l 


Then 


(3.2) 


d$>F(x) 

dx 


_„fj& _ 

g[G_1F(x)] 


*  $  V>° 


y-F(x) 


8[0~V«>1 

f(x) 


when  the  derivatives  exist. 


Definition: 

r(x)  - - -  is  called  the  generalized  failure  rate  function. 

gfG'Vx)] 

The  following  two  important  cases  are  worth  noting.  Let 

(1)  G  be  the  uniform  distribution  on  [0,1]  .  Then  r(x)  -  f(x)  . 

(ii)  G  be  the  exponential  distribution  on  [0,®)  with  mean  1  .  Then 

fix)  _ 

r(x)  ■  ^  ..  f(x)  »  t^'e  Failure  rate  function  of  F  . 

If  F  is  the  empirical  distribution  function  for  F  ,  based  on  a 
n 

sample  of  size  n  ,  the  natural  estimators  of  4>p(x)  and  $p(y)  are  given  by 
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(3.11  U)  -  G  1Ft  (*)  ,  (y) 

r  nr 

n  n 


I 


G  (u)1du 
L  11  j 


When  v  «  —  and  X , . 

n  1 


X  art*  the  ordct  scat  in  cict-  fron  F  , 

n 


i-1  r 


vh*:tf  }»  $ 

V 


-■•(Generalized  tot  si.  tine  on  at  statistic)  . 
n 


Of  t  penial  interest  are  estimators  b?icd  on  grids  with  wider  spacings 
than  those  provided  by  order  statistics.  We,  therefore,  define  an  analogue 


of  the  empirical  distribution  ior  more  general  grids.  Let  iw  1  be  a 

l  1,nJi=0 

subdivision  of  a)  and  define 


(3.4) 


F(x)  -  F  (w  ) 
n  n  i  ,n 


W  <  X  <  w.  .  . 
i,n  —  i,n+l 


Remark  3.1: 


If 


/  00 

Jw.  )  becomes  dense  on  the  support  of  F  with  probability  1, 

l  i,nfi=0 


it  can  be  proved  along  the  lines  of  the  proof  of  the  Glivenko-Cantelli 
theorem  that 


(3.5) 


P|  sup  F  (x)  -  F(x)  |  -  o 
n 

-oo<X<*> 


=  1 


/  .00  , 

Note  that  the  grid  Jw  I  (observer' s  grid)  is  the  grid  used  in 

l  i,nJi=0 

observing  the  data  and,  in  general,  need  not  be  the  same  as  the  set 


'0 


(analyzer's  grid)  used  in  analyzing  the  data.  With  F 


4 


defined  in  (3.4),  4>  *(x)  -  G  (x) 

F  n 
n 

are  well  defined  and  estimate  <J>  (x) 

r 

Within  parenthesis  is  given  the 
out  this  thesis. 


F  (y) 

and  $  ^(y)  ■  J 

F  s. 

n  1 


;[°-lF*(u>] 


du 


and  <t»p  (y )  respectively. 


meaning  of  abbreviations  used  through- 


a.s.  (almost  sure,  almost  surely) 
w.p.l.  (with  probability  1) 

[  ]  ([a]  is  the  largest  integer  less  than  or  equal  to  a) 

=  (is  defined  to  be) 

&  s  • 

'  (almost  sure  convergence  or  convergence  w.p.l.) 

S  (convergence  in  probability) 

5  (convergence  in  distribution) 

0  (•)  (X  H  0  (x  )  if  X  /x  is  bounded  in  probability,  i.e.,  if 

p  npn  nn  r  /*» 

for  each  e  >  0  ,  there  is  an  M  and  an  N  9 

e  e 

P(  |X  I  >  M  x  }  <  e  V  n  >  N  .) 

1  n1  —  £  n  —  —  c 

o  (•)  (X  =  o  (x  )  if  |x  |  /  x  So  as  n  ■+•  00  ,  i.e.,  if 

p  n  p  n  'n'  n  ’  * 

P{  lx  I  >  ex  }  -►  0  as  n  ■+•  ®  for  each  e  >  0  .) 

n  n 

:  (indicates  end  of  a  proof). 


A  final  note  on  notation:  all  equations,  lemmas,  theorems  etc.  are 
numbered  on  their  respective  scales.  The  number  referring  to  the  chapter 
is  dropped  if  the  reference  is  made  within  the  chapter. 


4.  Overview  of  Chapters 

Some  useful  convergence  properties  of: 

A 

(i)  a  class  of  estimators  for  density  functions  based  on  F^  ,  and 

(ii)  the  estimators  <p  *  and  $  ^ 
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as  well  as  conditions  for  the  consistency  of  an  estimator  of  the  change 
point  of  a  function  are  given  in  Chapter  II.  These  results,  besides  being 
used  in  subsequent  chapters,  are  Interesting  in  their  own  right  and  useful 
in  solving  allied  problems.  See  references  [1],  (?].  Also  given  are  some 
known  results  on  the  weak  convergence  of  probability  measures. 

The  motivation  for  the  proposed  estimators  stems  from  (3.2).  In  the 
derivation  of  asymptotic  distributions,  we  place  the  following  restrictions 
on  the  observer's  and  analyzer's  grids: 


(i)  n 


• 5  ML 


(ii)  (jj.,,  -  w,  *  0  (cn  a )  for  ail  i  and  c  >  0  ,  a  >  0  . 

i+l,n  i,n  p 


The  grid  is  said  to  be  "wide"  for  0  <  a  <  1/3  and  "narrow"  for 

1/3  <_  a  <_  1  .  Of  special  interest  will  be  the  rate  at  which  the  grid  spacings 

are  required  to  converge  to  zero. 

In  Chapters  III  and  IV,  we  confine  ourselves  to  estimators  based  on  the 
<P  transformation.  The  value  of  x  ,  not  necessarily  unique,  which  minimizes 

<f>  A(x  +  a)  -  <{>  *(x  -  a)  |  among  all  x  e  ft  is  said  to  estimate  the 

F  F  n 

n  n  J 

change  point.  The  interval  "2a"  is  called  a  window  and  the  estimator,  a 
window  estimator.  When  a  is  fixed,  the  estimator,  termed  fixed  window 
estimator,  is  considered  in  Chapter  III  and  when  a  -*•  0  as  n  -*•  ®  ,  the 
corresponding  estimator,  termed  narrow  window  estimator,  is  considered  in 
Chapter  IV.  Consistency  and  asymptotic  distribution  are  dealt  with  in 
each  case. 

Estimators  derived  from  the  $  transformation  are  considered  in 
Chapters  V  and  VI.  The  value  of  x  ,  not  necessarily  unique,  which  maximizes 

$  .  (f  (x)  +  b)  -  $  .  (f  (x)  -  b)"|  among  all  x  z  ft  is  said  to  estimate 

*  \  n  /  v  \  n  M  n 


n  n 

the  change  point.  The  case  of  fixed  b  is  considered  in  Chapter  V  and 
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b  -*•  0  as  n  -*■  “  in  Chapter  VI.  It  is  interesting  to  note  that  to  Insure 
the  existence  of  the  asymptotic  distributions,  if  the  window  is  fixed  (narrow), 
the  grid  is  required  to  be  narrow  (wide).  A  comparison  of  the  two 

narrow  window  estimators  is  made  at  the  end  of  Chapter  VI. 

In  conclusion,  other  estimators  of  the  change  point  as  well  as  a  dis¬ 
cussion  of  computational  aspects  are  given  in  Chapter  VII.  Bray,  Crawford 
and  Proschan  [4]  deal  with  the  maximum  likelihood  estimation  of  a  U-shaped 
failure  rate  function  and,  as  a  by-product,  estimate  the  change  point. 
Analogously,  the  U-shaped  generalized  failure  rate  function  may  be  estimated 
by  methods  similar  to  Barlow  and  van  Zwet  [1,2]  and  hence  estimate  the 
change  point.  The  development  of  the  estimation  problem  in  this  thesis 
presents  a  natural  way  of  obtaining  consistent  estimates  of  the  change  point. 
Some  recommendations  regarding  the  choice  of  the  windows  and  the  grid 

SI  ,  and  results  of  Monte  Carlo  investigations  are  included  at  the  end  of 

n 

Chapter  VII. 

A  computer  program  has  been  written  in  FORTRAN  IV  to  obtain  the  narrow 
window  estimates  of  the  change  point.  A  discussion  of  the  program,  along 
with  its  listing,  is  given  in  the  Appendix. 
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CHAPTER  II 

SOME  CONVERGENCE  THEOREMS 


1.  A  Class  of  Estimators  for  Density  Functions 


Let 


be  a  grid  which  becomes  dense  on  the  support  of  F 


w.p.l.  as  n  -*•  ®  .  We  saw  in  Remark  1.3.1  that  Fn(x)  >  defined  by 


F*(x)  =  F  (w.  ) 

n  n  i  ,n 


tends  to  F(x)  w.p.l.  uniformly  in  x  ,  where 
distribution  function  for  F(x)  . 

To  estimate  f(x)  ,  the  density  of  F(x)  , 
the  form: 


w.  <  x  <  w. 
i,n  —  i,n+l 


F  (x)  is  the  empirical 
n 


we  consider  a  statistic  of 


(1.1) 


dF* (u) 
n 


where  K(x)  is  a  certain  density  function  and  h  -*■  0  as  n  -*■  00  .  Such 

* 

estimates  have  been  studied  by  Nadaraya  [11]  and  Parzen  [12]  when  ~  • 

Theorem  1.1: 

Let  the  following  assumptions  hold: 


(1.A1)  K(x)  is  a  function  of  bounded  variation  (with  bound  p) 


(1.A1) 

K(x) 

(1.A2) 

f  (x) 

00 

(1.A3) 

l 

n*l 

(1.A4) 

w 

i+1 

Then 

-  w, 


o(h)  for  all  i  . 
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(1.2) 


P  lim  sup  jf^Cx)  “  f  (x)  |  -  0  I  ■  1  . 

n-H»  —  QO<X<® 


■] 


Proof: 


uD 

let  fn(x)  -  i  |  dF^ 


(u) 


sup  |  f  (x)  -  f  (x)  |  *  sup 

-oo<x<oo  -®<x<o 


h } 


00 

-h  j  *hr)d* n<u) 


<_  sup 


-»<X<co 


-oo<x<«> 


i.  SUP 
i 


00 

- 

u 

|Fn(u)  -Fn(u)|  |dK(\U)| 

j  —00 

- 

|F*(x) 

-  F  (x) |— 

1  n 

n  'h 

ViV 

-  F„(w< 
n  i  ,n 

h 

0  w.p.l.  by  (1.A4)  and  Theorem  1,  [ 11 ] . 


3  •  S  • 

From  Nadaraya  [11],  fR(x)  *  f(x)  uniformly  in  x  .  Hence 


fQ(x)  a>8*  f(x)  uniformly  in  x  .  | | 


2.  Properties  of  the 


^  and  $  *  Transformations 


n 


Theorem  2.1: 


If  the  support  of  G  is  an  interval,  then 


(2.1) 


(x)  -  $p(x) |  - 


ol  .  i 


for  each  x 
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In  addition,  if  the  support  of  G  is  bounded,  then 


(2.2) 


P  sup  |$  *(x)  -  4>  (x)  I  -*■  0 

-»<X<00  F 

n 


1  . 


Proof: 

Since  G  is  strictly  increasing,  G  ^(y)  is  continuous  in  y  , 

0  y  <_  1  .  By  Remark  1.3.1,  Fn(x)  a+S"  F(x)  uniformly  in  x  and  (2.1) 
follows  from  the  continuity  of  G  ^  . 

If  the  support  of  G  is  finite,  by  Proposition  16,  p.  164,  Royden  [15], 
G  ^(y)  is  uniformly  continuous  in  y  ,  0  <  y  <  1  .  (2.2)  now  follows  from 

Remark  1.3.1.  | | 


The  following  lemma  is  any  easy  consequence  of  Proposition  6f.2(i), 
p.  355,  Rao  [14]  and  the  Glivenko-Cantelli  Theorem. 


Lemma  2.1: 


Let  the  support  of  F  be  an  interval. 


(2.3)  If  the  support  of  F  is  not  bounded,  then 


lF”1(y)  -  F”x(y) |  -  0 


.-1, 


-  1 


for  0  <  y  <  1  . 


(2.4)  If  the  support  of  F  is  bounded,  then 


sup  |  F  1  (y)  -  F  1  (y)  |  -*■  0 
°<y<l 


]- 


We  give  below  conditions  for  the  strong  uniform  convergence  of  $  (y) 


to  ^P(y)  •  Weak  consistency  of  0  ,  is  shown  in  Theorem  (2.3)  under  less 
F  F 

n 


stringent  assumptions  on  the  grid 


N-E. 


10 


The  following  theorem  is  due  to  Barlow  and  van  Zwet  [1], 

Theorem  2.2; 

Let  conditions  (2.A1),  (2.A2)  and  either  (2. A3)  or  (2.A4)  and  (2.A5) 
be  satisfied. 


(2.A1) 

The  support  of  F  is  an  interval. 

(2.A2) 

Either 

it  .  vOD 

F  H  F  or  the  grid  Jw.  1  becomes 

"  n  >  1-nfi-o 

dense  w.p.l.  on 

(-*,“) 

Wi  n 

and  - 1 —  <  M  w.p.l.  V  i  ,  for  some 

Wi-l,n 

M  <  00  . 

(2. A3) 

f‘1(o) 

>  and  F  *(1)  <  00  . 

(2.A4) 

F_1(0) 

oo  oo 

>  -00  ,  F  ^(1)  ■  “  ,  J  xdF(x)  <  °°  ,  J* 

S1  S1 

g[G  1F(x) ]dx  <  »  . 

(2.A5) 

gG_1(0 

has  a  continuous  derivative  ip  on  [0,1]  . 

Then 

(2.5) 

p|  sup  ,(y)  -  *_(y)  1  -*  0*1  ■  1  . 

L0^1  f„  J 

Theorem  2.3: 

Let  the  following  conditions  be  satisfied. 


(2.A6) 

G(x)  has  a  continuous  derivative  g(x) 

in  the  interior  of  its 

support. 

(2.A7) 

The  support  of  F  is  a  finite 

interval. 

(2.A8) 

The  probability  that  the  grid 

N-L 

becomes  dense  on  [s^.s^ 

approaches  1  as  n  -*■  ®  . 

11 


Then,  for  any  e  >  0 


(2.6) 


lim  P  |<J>  *(y)  -  $F(y) 
n-+°° 


0  <  y  <  1 


Proof : 


f„  (y) 


*  *(y)  -  ^(y)  =  j* 


g  G_1F*(u)  du  -  J 


F-1(y) 


g[G  1F(u)]du  . 


Expanding  in  Taylor's  series  about  F  ^(y)  , 


(2.7)  $ 


t(y)  -  <t’F(y)  *  (y)  -  F  1(y)jg|^G  1F(^n) 


where  x  lies  between  F  (y)  and  F  (y)  . 
n  n  }  J 


*~l  .-1 


Fn  (y)  -  f  (y)l  1  lwi+l,n  '  wi,J 


+  | F~1(y)  -  F_1(y) 


0  ,  by  (2.A8)  and  Lemma  2.1. 


This  proves  the  theorem. 


3.  A  Consistency  Condition 

We  give  below  a  strong  consistency  condition  for  the  estimator  of  the 
change  point  of  an  arbitrary  function  V  defined  on  some  interval  [a,b]  . 


12 


Let  6  be  the  change  point  of  'f(x)  ,  i.e.,  0  minimizes  Y(x)  , 

and  ¥  (x)  estimates  VCx)  .  0  minimizes  V  (x)  among  all 

n  n  n  ° 


x  e  ft 


m; 


Theorem  3.1: 

Assumptions ; 

rJ.Al)  41  (x)  a-*S’  'i'(x)  uniformly  in  x  e  [a,b]  . 

n 

(3.A2)  0  ,  assumed  unique,  minimizes  ^Cx)  . 

(3. A3)  0  minimizes  'i  (x)  where  x  is  confined  to  ft 
n  n  n 

(3.A4)  is  a  grid  on  [a,b]  such  that  w.p.l,  it  becomes  dense  in  some 

neighborhood  of  0  . 

(3.A5)  For  all  6  small  enough  a (6)  >  0  where 
a  (6)  «  a2(<S)  -  a1(5) 
a^(6)  »  max  {'J'(x)  :  0-5<_x<^0  +  6} 
a^Cd)  *  min  {H'(x)  :a<x<_0-25,0  +  2S<_x<b}  . 

Then 

(3.1)  e  a-5-3,  8  . 

n 

Proof: 

For  6  arbitrary,  but  fixed,  choose  e  ■  a(6)/2  .  Then 

3  n  5  n  (e)  >  for  all  n  >  n 

o  o  o 

|*n(x>  -  Y(x) I  <  e 


V  x  . 


13 


By  (3.A4) ,  w.p.l.  3  n.  >_  n  )  for  all  n  >  n.  ,  |w.  —  8  j  <6  for 

X  0  X  K  *n 

n 

some  kn  .  For  a  <  x  <_  0  -  26  or  0  +  26  <_  x  <  b  ,  and  n  > 

V*1  -  f(“kn,n)  >  ’<*>  -  *(\,„)  '  2£ 
i  a2(6)  -  0^(6)  -  2e 

■  a(6)  -  2e 

■  0  . 


But  0  minimizes  ¥  (x)  =>  f  ( 0  )  -  ¥  /u.  \  <  0  .  Hence 

o  n  nW 

A 

0  -  26  <  9^  <  9  +  26  .  Since  6  may  be  arbitrarily  small,  it  follows 
that 

0n  3-VS*  9  .  |  | 

Remark  3.1: 

It  is  obvious  that  a  corresponding  result  can  be  proved  when  the 
change  point  is  defined  to  be  the  maximizing  point  of  Y  . 

Remark  3.2: 

Let  £2  be  a  grid  determined  by  the  order  statistics  from  the  under- 

n 

lying  distribution  F  ;  id,  »  X.  where  X,  is  the  ith  order  statistic 

i,n  i  i 

from  F  .  If  F  is  strictly  increasing  in  a  neighborhood  of  0  ,  then 

£2  becomes  dense  w.p.l.  around  0  . 
n  r 
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4.  Some  Theorems  on  the  Weak  Convergence  of  Probability  Measures 

We  give  below  some  known  results  on  weak  convergence  in  the  space  of 
functions  with  at  most  discontinuities  of  the  first  kind. 

4.1  Weak  Convergence  in  Dfa.b] 

Let  C[a,b]  denote  the  space  of  continuous  functions  on  [a,b]  and  D[a,b] 
denote  the  space  of  functions  on  [a,b]  that  are  right-continuous  and  have 
a  left-hand  limit.  We  induce  convergence  in  D[a,b]  by  Skorokhod's 
Jj-topology.  It  is  well  known  that  C[a,b]  with  the  supremum  norm  topology 
is  a  closed  subset  of  D[a,b]  with  J^-topology. 

A  sequence  of  stochastic  processes  with  trajectories  in  D[a,b]  a.s. 

is  said  to  converge  in  distribution  to  another  process  X  with  trajectories 
in  D[a,b]  a.s.  if  the  measures  vn  induced  by  X^  on  D[a,b]  converge 
weakly  to  the  measure  v  induced  by  X  on  D[a,b]  . 

Weak  convergence  in  D[a,b]  ,  when  [a,b]  is  a  compact  interval,  is 

given  in  detail  in  Billingsley  [3].  Following  Stone  [17],  we  extend  this 

* 

concept  to  D  (-<•>,<*>)  . 

* 

4.2  Weak  Convergence  in  D  (-°°.°°) 

Let  E  be  a  complete,  separable,  metric  space,  with  metric  p  .  We 

* 

denote  by  D  (—<*».“»)  the  space  of  all  R-valued  functions  x(t)  ,  <  t  <  00  , 

which  have  a  limit  from  the  left  and  are  continuous  from  the  right.  Define 

on  D  the  topology  :  a  sequence  xn(t)  is  said  to  be  J^-convergent 

to  x(t)  if  there  exists  a  sequence  of  continuous  one-to-one  mappings 

An(t)  of  the  interval  (-00,®)  onto  itself  such  that  for  each  N  >  0 

sup  |A  (t)  -  t|  -►  0  and  sup  o(x  (t),x(A  (t)))  -*-0  as  n  •*  00  .  Note 
-N<t<N  “  -N<t<N  n  n 

that  for  continuous  x(t)  ,  x^t)  converges  to  x(t)  in  the  J^-topology  if 
and  only  if  for  each  N  >  0 
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sup  p(x  (t),x(t))  -*■  0  as  n  «  . 

-N<_t<_N  n 


A  stochastic  process  W  on  is  said  to  be  a  two-sided  Wiener- 

L6vy  process  if  it  is  a  Gaussian  process  with  stationary  independent  increments 
with  (i)  W(0)  -  0  (ii)  E[W(t)]  -  0  for  |t|  <  »  (iii)  Var  [W(t)  ]  -  |t|  . 
Further,  from  the  law  of  iterated  logarithm  for  a  Wiener  process, 

W(t)  e  C  v.p.l.,  where  C  (-“,*)  is  the  space  of  all  continuous 

•k 

function  on  (-®,00)  and  hence,  in  particular,  W(t)  e  D  (-<*>,<»)  . 

From  Stone  [17]  and  problem  1,  515,  Billingsley  [3],  we  get  necessary 

and  sufficient  conditions  for  the  weak  convergence  of  a  sequence  of  random 

variables  X  (t)  to  X(t)  . 
n 

Theorem  4.1: 

The  sequence  ^^(t)  is  weakly  convergent  to  X(t)  if  and  only  if 

(4.1)  the  finite  dimensional  distributions  of  X^(t)  converge  weakly  to 

the  finite  dimensional  distributions  of  X(t)  as  n  for  t  in 

some  set  everywhere  dense  on  (-*,“)  ;  and 

(4.2)  for  e  >  0  and  N  >  0 

min  [p(Xn(t1),Xn(t))  ;  p (Xfl(t) ,Xn(t2) ) ]  >  *  0  . 

Further,  if  almost  all  the  paths  of  X(t)  are  continuous,  then  (4.2)  may 
be  replaced  by  the  following  simpler  condition: 

(4.3)  lim  p(  sup  p(X  (tJ.X  (t.))  >  e)  ■  0  . 

n-H»;c-*0  )  !t1-t2l^c;-N£t1<t2<N  j 


11m  Pi  sup 
nr***  )t-c<t1<t2<t+c 

C^°  I  ’wlt1<t2iN 


(4.2)  is  the  condition  for  the  sequence  of  probability  measures  {P^} 
corresponding  to  to  be  relatively  compact  (Cf.  Billingsley  [3]). 
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(A. 2)  is  equivalent  to  the  following  two  conditions,  either  of  which  may  be 
used  to  verify  relative  compactness  of  {P^}  . 

(A. A)  Condition:  [Theorem  15.6,  Billingsley  [3]] 

For  each  N  >  0  , 

E{|Xn(t)  -  Xn(t1)|Y|xn(t2)  -  Xn(t) |Y}  <  [B(t2)  -  B(t^) ]2a 

for  -N  <_  t^  t  t2  and  n  >_  1  where  y  >_  0  ,  a  >  h  and  B  is  a  non¬ 
decreasing  continuous  function  on  . 

(A. 5)  Condition:  [Theorem  2. 5. A,  Rao  [13]] 

For  each  N  >  0  ,  there  exist  constants  yn  >  0  ,  CN  >  0  independent 
of  n  such  that  for  every  t^  ,  t2  e  [ — N , N ] 

EjlW  +  '2I  • 
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CHAPTER  III 

FIXED  WINDOW  ESTIMATORS  BASED  ON  THE  TRANSFORMATION 


1.  The  Estimator  x 
_ a 

In  this  chapter,  we  shall  be  concerned  with  fixed  window  estimators 
using  the  <f>  transformation  and  "a"  is  the  fixed  window.  Recall  that 
4>p(x)  =  G  1F(x)  . 


r  (x) 


S  Vx) 


f  (x)  _ 

g[G_1F(x)]  ' 


Hence 


<frp(x  +  a)  -  4>f(x  -  a) 
2a 


approximates  r(x)  . 


i.e.,  let  -«>  <  w  <  a)  <...<(!),  <  ...  < 

0  ,n  l,n  i,n 

(-®,00)  and  n 


« ■  M. 


Define  51  as  in  Chapter  I; 
be  a  subdivision  of 


Definition: 

The  pseudo  change  point  of  r(x)  is  given  by  x  ,  assumed  unique, 

cl 

minimizing  [<t>f(x  +  a)  -  <J>p(x  -  a)]  . 
x  ,  estimating  x  ,  minimizes 

3  S 


<f>  *(x  +  a)  -  $  *(x 

F  F 

.  n  n 


where  x  is  restricted  to  fl 

n 

2.  Consistency 

When  the  support  of  G  (an  Interval)  is  finite,  we  show  in  Theorem  2.1 
that  x  is  a  strongly  consistent  estimator  of  x  .  When  the  support  of 

dt  ci 

A  ^ 

G  is  infinite,  it  is  shown  in  Theorem  2.2  that  x  converges  to  x  in 

cl  3 

probability. 
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Theorem  2.1: 

Let  the  following  assumptions  be  satisfied. 

(2.A1)  The  support  of  G  is  a  bounded  interval. 

(2.A2)  becomes  dense  w.p.l.  in  the  neighborhood  of  x 

n  a 

(2. A3)  For  all  5  small  enough,  a(5)  >  0  where 
a  (6)  ■  a2(<$)  -  <^(6) 

a^(5)  ■  max  +  a)  -  ^(x  -  a)  :  x^  -  6  <_  x  <_  x&  +  6 

a2(6)  »  min  +  a)  -  $p(x  -  a)  :  <  x  x&  -  26,xa 

Then 

(2.1)  x  x  . 

a  a 

Proof : 

a  •  s  • 

From  Theorem  II. 2.1,  ♦  *(x)  ■+  $  (x)  uniformly  in  x  . 

F  F 

n 

II. 3.1,  make  the  following  identification: 


e 


e 

n 


x 

a 


^  (x)  -  $  (x  +  a)  -  $_(x  -  a)  ,  H1  (x)  -  d>  *(x  +  a)  -  <J>  *(x  -  a) 
r  r  n  _w  _ 

F  F 

n  n 

From  Theorem  II. 3.1,  x  a-+S*  x  .  || 

a  a  '  1 

Remark  2.1: 

When  G  is  the  uniform  distribution  on  [0,1]  ,  r(x)  »  f(x) 
get  a  stronger  version  of  Theorem  1,  Section  5,  Chernoff  [5]. 


+  26  x  <  s2 


In  Theorem 


and  we 
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Convergence  of  x  When  the  Support  of  G  is  Not  Finite. 

_ _  3 _ _  _ 

Assumptions : 

(2.A4)  [$_(x  +  a)  -  $  (x  -  a)]  is  continuous  at  x 

r  r  3 

(2.A5)  The  support  of  G  is  an  interval. 

(2.A6)  The  probability  that  the  set  becomes  dense  on  the  support  of 

F  approaches  1  as  n  ■*  00  . 


Lemma  2.1: 


(2.2)  min  <j>  A(x  +  a) 

xeQ  F 
n  |_  n 


Proof: 

p 

From  Theorem  II. 2.1,  $  *(x)  $  (x)  for  each  x  . 

F  F 

n 


min 

4>  ft(x  +  a)  -  4)  *(x  -  a) 

F  min 

$  A(x  +  a)  -  $  A(x  -  a)l 

XEfl 

n 

F  F 

n  n 

X 

F  F 

n  n  J 

P 

•*  min  [ (x  +  a)  -  4>F (x  -  a)] 
x 


since 


by  (2.A6) 


(i) 

(ii) 


*(x  +  a)  -  $  *(x  -  a)j  F  [4>p(x  +  a)  -  4>p(x  -  a)]  for  all  x  , 

[$_(x  +  a)  -  $_(x  -a)]  is  continuous  at  x  by  (2.A4),  the  last 
r  t  a 

step  follows  from  Corollary  1  to  Theorem  5.1,  Billingsley  [3].  |  j 


and 


Theorem  2.2: 


Under  Assumptions 


(2.A4)  -  (2.A6), 


x 

a 


P 


x 

a 


(2.3) 
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Proof : 


From  problem  40,  p.  180,  Royden  [15]  and  by  (II. 2.1),  <|>  converges 

F 

continuously  to  w.p.l.  Hence  for  sequence  {x^}  x  ,  n 


<t>  *(x  +  a)  -  .(x  -  a) 

F  n  p*  n 

.  n  n 


converges  continuously  to  [<f>_(x  +  a)  -  4>  (x  -  a)  ] 

F  F 


w.p.l.  The  function  <p  .  and  <J>  are  measurable  mappings  from  R  to  R 


Hence  by  Theorem  5.5,  Billingsley  [3],  letting 


h  (x)  -  <p  4(x  +  a)  -  .  (x  -  a) 


h(x)  *  4p(x  +  a)  -  ^p(x  -  a) 


we  get  by  Lemma  2.1 


h  1  ( min 
n  {  xefi 


|"V(X  + 

h  L  n 


'll 


a)  -  ♦  *(x  -  a)]  (  -*•  h"*1  /rain  [4>_(x  +  a)  - 


1  x 


4>p(x  -  a)] 


A  P  ' 

i.e. ,  x  •*  x 
a  a 


3.  Asymptotic  Distribution 


Assumptions : 


(3.A1)  F(x)  is  continuous  with  density  f(x)  . 

(3.A2)  r(xa  +  a)  >  0  ;  r(*a  -  a)  >  0  . 

3 

(3. A3)  g'(x)/g  (x)  is  bounded  for  x  in  the  support  of  G  (an  interval), 

(3.A4)  [$  (x  +  a)  -  #_(x  -a)]  is  differentiable  at  x 
r  r  a 

-1/3 

(3.A5)  uj  ,  .  -  —  u> .  ■  o  (n  )  (i.e.,  ft  is  a  narrow  grid). 

1+1 , n  l , n  p  n 


It  is  easy  to  see  that  these  assumptions,  which  are  necessary  in  the 
derivation  of  the  asymptotic  distribution,  are  sufficient  to  insure 
consistency  of  x^  . 
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Since  x  minimizes  [$  (x  +  a)  -  <J>  (x  -  a)]  ,  we  have 
a  r  f 


(3.1) 


r(*a  +  a)  -  r(xa  -  a)  . 


Let 


(3.2) 


h  (x) 
n 


<>F  (x  +  a)  -  <J>F  (x  -  a) 
L  n  n 


x  minimizes  h  (x)  and  hence  minimizes 
a  n 


(3.3)  hn(x)  -  hn(*a)  =  Up  (x  +  a)  -  $p  ^  +  an  -  Up  (x  -  a)  -  <J>F  ( 

L  n  n  J  L  n  n 


where 


x  -  a 
a 


(3.4)  Y 


-■IK 


-  Y  +  u 
n 


(x  +  a)  -  ♦pJxa  +  a)  -  [tp(x  +  a)  -  *F(xa  +  a )1  j 


|[*Fn(x  "  3)  "  "  3)  ‘  [»F(x  -  a)  '  *F(Xa  “  a)]| 


and 


(3.5)  u  -  $F(x  +  a)  -  #F(xa  +  aj "J  -  jj>p(x  -  a)  -  tp(xa  -  ajl  . 


Let  6  =  x  -  x  .  Note  that  x  c  fl  .  Expanding  in  Taylor's  series, 


F^(x  -*•  a)  -  F^^x^  +  aj  F(x  +  a)  -  F^x^  +  a) 


e'\(\ +  a>] 


G"1F(x  +  a 
a 


-(> 


lFn(x  ~  a)  ~  Fn(Xa  "  a)  _  F(x  ~  a)  ~  F(xa  *  a) 

*P\(C-  a)j  6  jo'Mxa  - 


+  0  (n-16) 
P 
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r(xa  4  a)  | 


f(ia  +  a)  I  *•  " 


F^(x  +  a)  -  ^n^xa  +  aj  ~  F(x  +  a)  -  F^xa  +  a 


rfx  -  a)  ( 


{  [Fn(x  -  a)  -  Fn(xa  *  a)]  *  [F(x  '  a)  '  F(xa  ‘  a)]  j 


+  0  (n_ii6) 
P 


(Xa  +  a) .  r(Xa  -  a) 


r f  x  +  a)  r ix  -  a  i  , 

(3.6)  Y.  -  -J - r  Vnl(S)  -  Tyr* - -  Vn2(5)  +  0  (n^S) 


f(xa  +  a) 


f(xa  -  a) 


where 


(3.7)  Vnl(6)  -  +  a  +  6)  -  fJ^  +  a)]  -  [f^  +  a  +  «)  -  F^  -  a 


and 


(3.8)  Vn2(6) 


i*  y 

/-  .1 

r 

/*■  y 

F  (x  -  a  +  6 
n\  a  / 

-  F  (x  -  a) 

n\  a  / j 

- 

F(xa  -  a  +  5) 

-  F(xa  - 

Expanding  u  by  Taylor's  series,  the  first  term  about  ^xa  +  aj  ,  the 
second  term  about  (xfl  -  aj  and  noting  that  r^xa  +  aj  ■  r(xa  -  aj  »  we 
see  that 


(3.9) 

where 

(3.10) 


u  ■  +  0  (53) 

P 


,  .  t’(ia  +  a)  -  r'(xa  -  a). 


* .  h  (x) 
n 


:(x  +  a)  r(x  -  a ) 

V  a  l  „  /fX  \  a  / 

'(xa  -  a) 


..  .  r  x  +  a, 

\(xa)  '  - - -  V-'(6) 


f(xa  +  a) 


V„2(S) 


+  4y<5^  +  Op(n  ^<5)  • 


0.11) 
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We  note  that 


(3.12) 


E[Vnl(6)]  =  EfVn2(4)1  =  0 


fix  +  a 

(3.13)  Var  [V  .  (5)  ]  =  - - - -  +  0  (n  *-5‘) 

ni  n  p 


(*a+a)|6|  , 


(3.14) 


Var  ^(5)] 


'(“a  '  a),6i  .  .  ,  -1 


+  0  (n  -6) 
P 


The  correlation  coefficient  between  V  , (6)  and  V  _(6)  is  given  by 

nl  nz 


Cov  [V  (6),V  (5)3 

(3.15)  p  -  .  — n-" - -  —  - ~  -5  -  0  (5). 

/Var  [V  , (6)]-Var  [V  _ (6) ]  p 


nl 


n2 


Since  x  minimizes  h  (x)  -hfx  I  ,  5  »  x  -x  minimizes  (3.11). 
a  n  n'  a  /  a  a 

Let 


(3.16) 

(3.17) 


5  *  At 


r  -  r(xa  4  a)  -  r(*a  -  a) 


(3.18) 


Wn(t) 


2  " 

(f(xa  +  a)  f(xa’a)) 

1 


7Ti  v"i(u) '  Tr-1 — >  v-’(xc) 
_f(* ,  +  »)  f(xa  -  a/ 


n2 


-1~ 

Then  t  *  X  5  minimizes 


(3.19)  Z  (t) 
n 


W  (t)  + 
n 


1  1 

1 

n 

+  a) 

f(x 
'  a 

"I 


1J>\2t2  +  0  (n~^ 


5) 
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Choose  X  in  (3.19)  so  that  the  coefficient  of  t  is  one,  i.e., 


°  (£(«a  +  a)  +  f(*a  -  *)) 


X  - 

|*d 

r  i 

.  1 

,  2 
[nY 

,fK + 

a)  f(xa 

A 

'),  t  - 

rl(; 

a  xa ) 

minimizes 

X  Y  -  1 


1/3 


(3.21) 


Z  (t)  -  W  (t)  +  t2  +  0  (n"1/6t)  . 
n  n  p 


Reduction  to  a  Problem  in  Stochastic  Processes 
Lemma  3.1: 


W^(t)  is  asymptotically  normal  with  mean  0  and  variance  |t|  ,  for 


all  t  . 


Proof: 

From  (3.18)  and  (3.12),  W  (0)  -  0  and  E[W  (t)]  -  0  for  all  t  . 

n  n 

-1/3 

Since  p ^  ■  Op(n  t)  «  VR^(Xt)  aru*  \i2^C^  are  asymPtot*caHy  uncorrelated. 


Var  (W  (t)]  -  1 1 1  +  0  (n”1/3t)  . 
n  p 


From  DeMoivre-Laplace  Theorem 

(;)  \l(U>  5  N(o.f(^a  +  a)|C|) 

(i)\n2(»c)  5  N(0.f(;a  -  ,jiti) 
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and  since  vn]/*c)  and  Vn2^C^  are  asymPtot:'-ca^^y  uncorrelated,  we  have 

Wn(t)  5  W(t)  '  N(0 ,  |  1 1 )  .  I  I 

Remark  3.1: 

After  a  tedious  calculation,  it  can  be  shown  that  for  any  collection 
of  t^  ,  t^  ^  w*t*1  I  I  <  00  for  1  ^  i  k  ,  the  joint  dis¬ 
tribution  of  [W  (t. )  ,W  (t„),  W  (t,  )  ]  converges  to  the  multivariate 

n  i.  n  L  n  k 

normal  distribution  with  mean  0  and  variance-covariance  matrix  given  by 

(<5  (ti»tj>  min  <  I  c±  I  »  1 1 j  I  > > 

where 

!1  if  c  and  d  are  of  the  same  sign 

. 

0  otherwise 

W1  tu  the  above  results,  the  main  result  of  this  section.  Theorem  3.2, 
can  be  proved  by  arguments  identical  to  those  given  in  Sethuraman  [16], 
pp.  112-117.  We  shall  give  an  alternate  proof  using  Theorem  II. 4.1. 

Lemma  3.2: 

For  each  K  >  0  and  for  all  -N  t^  <_  N  ,  there  exists  a  constant 

>  0  independent  of  n  ,  t^  ,  t2  such  that 

(3.22)  E{[Wn(r.2)  -  Wn(t1)]4|  <  CN|t2  -  tj2  +  o(l)  |t2  -  tj  . 

Proof: 

Let  c»  *  — -  ;  c-  »  — t- ^ -  ;  c,  ■  c,  +  c,  .  Then 

f(xa  +  a)  f(xa’a) 
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VC)  -(tcl)  'c2Vnl(S)  -  c3V„2(5>)  ' 


Let  t1  <_  t2  . 


W  -  W  ’(a  Cl)  lC2IVal(S2>  '  W1  *  =31Vn2<V  '  W  1  > 

AAA 

From  the  elementary  inequality  (x  +  y)  <_  8x  +  8y 

(3.23)  E{iWn(t2)  -  Wn(tl)]4}  <  8=-W{c4E[Vnl(62)  -  Vnl(5l)]4 

+  4tVn2(V  -  Vn2«l>|4}  • 

If  f  is  the  value  of  the  density  at  the  mode,  we  note,  after  expanding  in 
Taylor's  series,  that 

Fl\  +  a  +  S2)  '  F(xa  +  a  +  *l)  i  f-(S2  -  51> 

F(xa  '  a  +  52)  ‘  F(xa  -  a  +  *l)  -  f‘W2  *  V  • 

After  a  tedious  calculation,  we  note  that 

“M'W  ■  W1*}  i  18f2(s2  -  v2  +  i  ({2  -  V  -  1  ■ l-2 


and  hence 


(3.24)  8c-3r2„2{o4E(Vnl(62)  -  V^)]4  +  c4E[Vn2«>2)  - 


-  CN<t2  "  tl)  +  2/3  *C2  "  *1? 


where 


CN  -  144c‘2£2(c4  +  c4)  >  0 
D  -  8c-2f(ca  +  c4 )  >  0  - 
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From  (3.23)  and  (3.24) 

E{(Wn(t2)  -  wn(ti)]4}icN|t2  -  tj2  +  o(1)|t2  -  ^1  .  M 


By  Remark  3.1  and  Lemma  3.2,  conditions  (4.1)  and  (4.5)  of  Theorem 

II. 4.1  are  satisfied  for  the  sequence  (W  (t)}  and  hence 

n 


W  (t)  "  W(t) 
n 


t2  +  0  (n’1/6t)  l  t 2  . 
P 


Hence  by  an  application  of  Slutsky's  Theorem  [Cf.  Cramer  [6],  p.  254],  we 
get 


Theorem  3.1i 

2  —1/6 

The  distribution  of  W^(t)  +  t  +  0  (n  '  t)  converges  to  the  distribu- 
2 

tion  of  W (t)  +  t  where  W(t)  is  a  two-sided  Wiener-Levy  process  with 
mean  0  ,  variance  1  per  unit  t  and  W(0)  =0  . 


The  Asymptotic  Distribution  of 


Theorem  3.2: 


(3.25) 


is  asymptotically  distributed  as  the  value  of  t  which  minimizes  the 

2 

stochastic  process  Z(t)  -  W(t)  +  t  ,  where  W(t)  is  a  two-sided  Wiener- 
L€vy  process  with  mean  0  and  variance  1  per  unit  t  and  W(0)  *  0  . 


Proof : 

'ft 

Let  z(t)  e  C  (-«,»)  and  k(z)  be  the  value  of  t  that  minimizes 


z  (t)  . 
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(i)  W(t)  =  0  [  2  1 1 1  log  log  1 1 1  ]  ^  as  |t|  -*•  »  (Cf.  Chernoff  [5])  and 
hence 

2  2 

W(t)  +  t  =  t  . 

Therefore,  k[Z(t)]  is  bounded  w.p.l. 

(ii)  Since  the  distribution  of  Z(t)  has  a  nonzero  density  on  «) 

for  eac‘>  t  ,  Z(t)  has  a  unique  minimum  w.p.l. 

* 

(iii)  Since  all  fV  trajectories  of  W(t)  are  in  C  (-oo,c'>)  w.p.l., 

* 

the  subset  in  C  (-°°,°°)  on  which  k  is  continuous  has  probability 
1  for  the  process  Z(t)  . 

From  Corollary  1  to  Theorem  5.1,  Billingsley  [3],  we  see  that 


k[Zn(t)]  5  k[Z (t) ]  . 


Further,  we  need  to  impose  the  following  restriction  on 

Defining  5.  *  us.  -  x  ,  since  t  *  X  ^5  we  have 
i  i,n  a 


Ci+1  ~  Ci 


ID...  “  tl>. 

i+l,n  i 


0,1,  . 


0  uniformly  in  i 


if 


in.,.  -  0). 

i+l,n  i,n 


,  -1/3. 
-  o  (n  ) 
P 


for  i  *  0,1,2, 


Hence  t  *  A  ^(x^  -  x  )  is  asymptotically  distributed  as  the  random  variable 
which  minimizes  W(t)  +  t  .  | | 


Remark  3.2: 

Let  -h  be  the  density  of  the  random  variable  which  minimizes  Z(t)  . 


Chernoff  [5]  proves  that 
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<Kt)  -  *sux(t2,t)ux(t2,-t) 


where  U(*,*)  is  the  solution  of  the  heat  equation 

*SU  *  -U 
XX  z 

2 

subject  to  the  boundary  conditions  (i)  U(x,z)  =  1  for  x  >_  z  and 
(ii)  U(x,z)  -*-0  as  x  -*>  00  .  Here  Ux  denotes  the  partial  derivative  of 
U(x,z)  with  respect  to  x  . 


Remark  3.3: 

-1/3 

If  (jj. . ,  -  u>.  *  cn  ,  asymptotically  one  looks  at  the  stochastic 

l+l , n  1 , n 

process  Z(t)  only  at  certain  fixed  points  t^  ,  with  spacings  given  by 


and  tg  >  ,  is  arbitrary. 

Remark  3.4: 

When  G  is  the  uniform  distribution  on  [0,1]  ,  r(x)  *  f (x)  and 


X 


8f(xa  +  a) 


11/3 


ny 


which  is  the  same  as  Equation  (3.10),  Chernoff  [5]. 
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CHAPTER  IV 


NARROW  WINDOW  ESTIMATORS  BASED  ON  THE  <*  TRANSFORMATION 


1.  The  Estimator  x 

a 

_  _ n 


^  •  s  • 

Since  $  .  (x)  -*  ‘  *  ,(x)  ,  a  natural  estimator  for  r(x)  is  given  by 

F  r 

n 


(1.1) 


r„<x) 


♦  *(x  +  a  )  -  $  *(x  -  a  ) 

F  n  F  n 

n _ n  _ 


2a 

n 


where  a  -*-0  as  n  -*■  «  .  We  shall  refer  to  2a  as  a  narrow  window, 
n  n 


Definition: 


The  change  point  xq  ,  assumed  unique,  minimizes  r(x)  . 

x  ,  the  estimator  of  x  ,  minimizes  r  (x)  among  all  x  e  1!  . 

a  on  n 

r. 


2.  Strong  Consistency 
If  in  (II. 1.1) 


we  get 


(2.1) 


'„*(»> 


F  (x  +  h)  -  F  (x  -  h) 
n  n 

2h 


Let  5  >  0  and 
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a,  (6)  =  max<r(x)  :x  -  6  <  x  <  x  +<5/ 
1  [  o  —  —  o  ) 


a„(6)  =  min<r(x)  :  s,  <  x  <  x  -  26  ,x  +  26  <  x  <  s„ > 
2  l  l—o  o  —  2) 

a  (6)  =  a1(6)/a2(5)  . 


Theorem  2.1: 

Suppose  that  the  following  assumptions  hold. 

(2.A1)  F  has  a  uniformly  continuous  density  f  . 

2 

“  -vna 
v  n 

(2.A2)  l  e  converges  for  every  positive  y 

n*l 


(2. A3)  Either  F  -  F  or  the  grid 


n 


w  -  w.  *  o(a  )  . 

i+1  ,n  i,n  n 


h.-L  1 


is  chosen  such  that 


(2.A4)  The  grid  >1^  becomes  dense  w.p.l.  in  a  neighborhood  of  x^  . 
(2.A5)  For  all  6  small  enough,  a (6)  <  1  . 


Then 


(2.2) 


a.  s . 

x  -*•  x 
a  o 

n 


Proof: 


The  proof  is  similar  to  the  proof  of  Theorem  1,  Venter  [18].  For  4 
arbitrary,  but  satisfying  (2.A5),  3  n  9  for  n  >  n  ,  |uv  -  x  '  <  5 


k  ,n  o 
n 


for  some  sequence  { k-n }  w.p.l,,  by  (2.A4).  Let 


0  *ui, 
n  k  ,n 
n 


hn(x> 


-1  *  -1  * 

G  F  (x  +  a  )  -  G  F  (x  -  a  ) 
n _ n  n _ n 

2  a 


(2.3) 
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Then 


h  (x) 
n 


*  * 

F  (x  +  a  )  -  F  (x-a) 
n _ n _ n _ n_ 

2a 


{G"l6»(x). 


where 


F  (x  -  a  )  <  B  (x)  <  F  (x  +  a  ) 
n'  n  —  n  —  n  n 


Since  a  -*■  0  ,  by  Remark  1.3.1,  6  (x)  aXs'  F(x)  uniformly  in  x 

n  n 


MO 

n  n 


F*(6  +  a  )  -  F* (0  -  a  ) 

n  n  n _ n  n  n 

2a 


g 


g"16  (e  ) 

n  n 


*  * 

where  F(0  -a)<B(0)<F(0  +  a  )  .  Choose  x  ?  x  <  x  -  35  or 

nn  n  —  n  n  —  n  n  n  —  o 

x  >_  Xq  +  36  .  Then  w.p.l.,  3  n^  n^  independent  of  x  such  that  for  all 
n  >  n. 


(2. A) 


f(x  -  5)  <  S  (0  )  <  f(x  +  6 ) 
'  o  /  —  n  n  —  1  o  f 


and 


(2.5)  either  S  (x)  <  F (x  -  6}  or  B  (x)  >  f(x  +  25) 
n  —  '  o  ’  n  —  '  o  ' 


(2.6) 


h  (x)  F  (x  +  a  )  -  F  (x  -  a  )  f 
n _  n _ n _ n _ n 

h  (0  )  F*  (e  +  a  )  -  F*(0  -  a  )  *  . 

n  n  n  n  n  n  n  n  f 


f”1b  (0  ) 

: _ n  n 


F_1B  (x) 
n 


-1  i 

F  XS  (x)  , 

g  j 


F_13  (0  )  I 

n  n  j 


Assumptions  (2.A1),  (2.A2)  and  (2. A3)  imply,  by  Theorem  II.  1.1  when 

*  * 

F  t  F  and  from  Nadaraya  [11]  when  F  i  F  ,  that 


n  n 


n  n 


*  * 

F(x  +  a)-F(x-a) 
n _ n _ n _ n_  a^s. 

2a 


(2.7) 


f(x)  , 


33 


uniformly  in  x  .  Hence  w.p.l.,  3  n2  1.  »  independent  of  x  ,  ? 


for 


any  two  points  x^  ,  x^  and  n  > 


(2.8) 


F*(x.  +  a  )  -  F* (x.  -  a  )  f 
n  1  n _ n  1 _ n 

*  * 

F  (x  +  a  )  -  F  (x_  -  a  )  f 
n  L  n  n  l  n 


F'lV*2>] 

- T  >  a 


F'VX1>] 


(6) 


*  * 

Choose  n  >  n^  and  let  9  =  6  *  .  From  (2. A)  and  (2.5),  for  n  >  n 

n 


(2.9) 


F_1B  (x) 
n 


f*16  (e) 

n 


t  > 


a2((S) 


—  ct^  (6 )  ci(S) 


w.p.l, 


Hence,  from  (2.6),  (2.8)  and  (2.9),  we  see  that 


hn(X>  a<6>  . 

rwi  “•p-1- 

n 


Therefore  x  minimizes  h  (x)  =>  h 
a  n 

n 


(x  Vh  (9)  < 

\  an/  n  “ 


.  .  x  -  36  <  x  <  x  +  36  w.p.l. 

o  a  o  r 

n 


Since  6  may  be  made  arbitrarily  small,  it  follows  that 


a.s. 

x  ■*  x 
a  o 

n 


3.  Asymptotic  Distributions 
Assumptions: 

(3.A1)  F(x)  has  a  uniformly  continuous  density  f(x)  . 

(3.A2)  r(x  )  >  0  and  r(x)  is  thrice  differentiable  in  a  neighborhood  of  x 

3 

(3. A3)  g'(x)/g  (x)  is  bounded  for  x  in  the  support  of  G  . 

(3.A4)  a  «  Cn”01  for  some  C  >  0  and  1/8  <  a  <  1/5  .  Note  that  (2.A2) 

n  — 

requires  <i  to  be  less  than  4  . 
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(3.A5)  »l+lfn  -  «1#n 


('^)  t 
\  n  /  ,  i.e . , 


Q  is  a  wide  grid.  Let 
n 


also  satisfy  (2.A4). 


We  shall  see,  in  the  sequel,  that  the  bounds  on  a  arise  naturally  and 
that  similar  results  can  be  obtained  for  0  <  a  <_  1/8  .  Methods  used  in 
this  section  are  similar  to  those  in  Section  III. 3  and  hence  proofs  are 
given  only  at  places  where  they  seem  to  be  necessary.  Assumptions  (3.A1)  - 
(3. AS)  insure  strong  consistency  of  x 

a 

n 

Since  x  minimizes  r(x)  ,  we  have 
o 

(3.1)  *•(«„)  -  0  . 

Let 


(3.2)  h  (x)  *  (*  +  a  )  -  $  (x  -  a  ) 

n  r  nr  n 

n  n 


(3.4)  „  -  [♦,<*  +  .n)  -  ♦F(xo  +  aj]  -  [*f(,  -  an)  -  *F(xp  -  »„)] 


and 


6  ■  X  -  X  ,  X  E  n 

o  n 

x  minimizes  h  (x)  and  hence  minimizes 

a  n 

n 

h  (x)  -  h  (x  )  ■  Y  +  u  . 
n  n\  o  /  n 


Expanding  in  Taylor's  series,  Y^  as  in  Section  III. 3  and  u  about  x^  , 


we  see  that 
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Y  =  -f — - — 7~ - t!|f  (x  +  a  ) 

n  4G  ^0  +  au>!'  " 


1  lr 

«[«' M*0  '  an>]  ,l  " 


Fix  +  a 


-  [f <x  +  an)  -  f(fo  +  aj]j 


x  -  a 
o  n  j 


[f(x  -  an)  -  F(xo  -  ajjj 


+  0  (n  2,6) 
P 


(3.5)  Y 


--^l'[F<,  +  a 


)  -  F  (x  +  a  \  -  Tf(x  +  a  )  -  f(x  -a)! 

n  n'o  iwjl  n  '  o  n  '  J 


F  (x  -  a 
n  n 


)  -  F  (x  -  a  0  +  |  F (x  -  a  )  -  f(x  -  a  )  J 
n'o  n  /J  L  '  n  /  '  o  n'j 


+  0  (n  ^-6  4  n  S*a  •$”*) 

n '  n  ' 


(3.6) 


u  *  a  r  lx 
a  Vo 


"(x  )62  4-  0  (n~3*63  4-  n_3:i6)  . 


Therefore  6  *  lx  -  x  ]  minimizes 

V  an  ° 


r\x  i  .  - 

(3.7)  h  (x)  -  h  (x  )  »  — V  (6)  +  a  r"(x  )i 

Q  Q'  O /  /  v  n  O'  O' 

f(Xo) 

4-  0  (n  ^*5  4-  n  i,a  *5^  4-  63a  4-  5a3) 

o'  n  n  n ' 


where 


(3.8)  V  (5) 

Q 


■  j|F  (x  4  a  )  -  F  (x  4-  a  0  -  !"f(x  +  a  )  -  f(x  4-  a  )  | 
I L  n  n  n'  o  n /j  l  n  '  o  n'jl 

-  I["f  (x  -  a  )  -  F  (x  -  a  j"'  -  F(x  -  a  )  -  f(x  -  a  )l| 
|L  a  n  n'  o  n'j  _  n  '  o  n'_  j 


(3.9) 


.  <5  -  \t 
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(3.10) 


Wn(t)  "  [T  '(^o)] 


Multiplying  (3.8)  by  f(xQ)l  • — and  noting  that  a  ■  Cn 

r(Xo) 


“  _i  * 

see  that  t  *  A  6  minimizes 


(3.11)  Z  (t)  -  W  (t)  + 

n  n 


f 2A  /“  vl  ^  f(Xo)  ,2  -o 

Lit  f(xJJ  -Tm  r  (xo)Cn 
rlxJ 


-a  2 


/  2-4a  2-10a  \ 

+  0  Id5*  +  n"a  +  n  3  63  +  n  3  6/ 


Choose  X  such  that  the  coefficient  of  t  in  (3.11)  is  one,  i.e., 


r(Xo) 


Hence 


(3.12)  A  -  Z1/3C_2/3f’1/3(*o)r2/3(xo)r""2/3(xo)n  3  • 

Therefore,  <5  «■  O  \n  3  t /  .  From  (3.11)  3nd  (3.12),  t  »  A  *Yx 

P  \  a, 

minimizes 

/  .  Sail  \ 

(3.13)  Z  (t)  •  W  (t)  +  t2  +  0  \n  3  t/  . 

n  n  p 


From  (3.10), 


W  (0)  •  0  and  E[W  (t))  -  0 

n  n 


,  we 


-  x 

o 


(3.14) 


for  all  t  . 
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By  a  straightforward  but  tedious  calculation  it  can  be  shown  that  (Cf.  Venter 
[18]) 

(3.15)  Cov  |w^(t)  ,Wn<t  )j  -  4{min(|  t|  ,2B)  +min(|t  |  ,2B)  -  min(|t  -  t  |  ,2B) 
where 

a 

(3.16)  B  -  lim  ~  . 

n-*cc 

In  particular, 

(3.17)  Var  [Wn(t)]  -  min  (|t|,2B)  . 

Note  that  for  a  >  1/5  ,  B  ■  0  . 

Reduction  to  a  Problem  in  Stochastic  Processes 

Hence  for  each  t  ,  WQ(t)  Is  asymptotically  distributed  as  a  normal 
random  variable  with  mean  0  and  variance  given  by  (3.17).  By  arguments 
similar  to  those  in  Chapter  III,  we  see  that  Wn(t)  Is  asymptotically 
distributed  as  W(t)  ,  a  Gaussian  process  with  mean  0  and  covariance  function 
given  by  (3.15)  arl  for  a  >  1/8  ,  by  a  simple  extension  of  Slutsky's  Theorem 
for  processes, 

Z  (t)  3  z(t)  .  w(t)  +  t2  . 

Q 

A 

The  Asymptotic  Distribution  of  x 

n 

Theorem  3.1: 


The  random  variable 
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o.»>  - ; 

is  asymptotically  distributed  as  the  variable  t  which  minimizes 
Z(t)  *  W(t)  +  t^  where 

(i)  for  «  *  1/5  ,  W(t)  is  a  Gaussian  process  with  W(0)  =  0  , 

E[N(t)]  *  0  for  all  t  and  covariance  function  given  by  the 

limit  in  (3.15);  and 

(ii)  for  1/8  <  a  <  1/5  ,  W(t)  is  a  two-sided  Wiener-Levy  process 

with  W(0)  =  0  ,  E [ W ( t)  ]  ■  0  for  all  t  and  variance  1  per 

unit  t  . 


The  grid  Q  has  to  satisfy  (3.A5),  viz. 


(3.19) 


i  *  0,1,  . . . 


Proof : 


By  virtue  of  preceding  arguments,  it  is  left  to  show  that  (3.19)  has 

wi+l  n  “  ui  n 

to  be  satisfied.  Since  t^+^  “  Ci  "  - l— X - order  to  look  at  all 


the  points  of  the  process  Z(t)  ,  asymptotically,  we  need 

if  u). 


i-m  (-^) 

Vl.n  -  “t.B  ’  V"  >  lf  “i+l,«  '  “i,n  *  °p'n  '  > 


we  look  at 


«1+i  n  -  n 

Z(t)  only  at  certain  fixed  intervals  given  by  lim  - 1 — - *—  and  for  a 

n-M= 

grid  whose  spacings  are  even  wider,  lim  P[t^+^  -  t^  >  M]  *  1  V  j M |  <  °°  .  | 

n-*» 


Remark  3.1; 

If  A  •  Cf(*o)  and  G  the  uniform  distribution  on  [0,1]  ,  Theorem  3.1 
yields  Theorems  3a  and  3b  of  Venter  [18]. 
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Remark  3.2: 

Theorem  3.1  could  have  been  derived  by  the  following  intuitive  approach 
using  Theorem  III. 3.2. 


Since  x  minimizes 
a 
n 


♦F(x  +  a  )  -  $*(*  -  a  ) 

-  ,  it  minimizes  r(x)  as 


2a 


n 


-1 


n  -*■  00  ;  i.e.,  x  ->  x  .  Expanding  the  terms  in  X  in  Taylor's  series 
n 

about  x  , 
a 

n 


1 1/3 


as  defined  in  (III. 3. 20),  we  get  noting  that  x  ■*  x 

a  o 
n 


l-2a 


X-1  -  2“1/3*C2/3f1/3(xo)r'2/3(xo)r"2/3(xo)n  3  [1  +  0(n"2a)] 
-*•  Normalizing  constant  for  ^xfl  -  xq|  in  Theorem  3.1. 
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CHAPTER  V 


FIXED  WINDOW  ESTIMATORS  BASED  ON  THE  $  TRANSFORMATION 


1.  The  Estimator 


*b 


In  this  chapter,  we  shall  be  concerned  with  fixed  window  estimators 
using  the  4>  transformation  and  ”2b"  is  a  fixed  window. 


F_1(y)  F_1(y) 

(1.1)  ^>F(y )  *  J  g[G  1F(u)]du  =  J 


dF(u) 


(1.2) 


r(x)  dy  F 


±  *.(y) 


y-F(x) 


g[G~1F(x)] 

f(x) 


(1.3) 


Fn  <*> 


*  *(y) 


J 


-i  * 

G  F  (u) 
n 


du 


Definition : 


x^  ,  assumed  unique,  is  said  to  be  the  pseudo  change  point  of  r(x) 
if  it  maximizes  ['ty(Fvx)  +  b)  -  4>p(F(x)  -  b)]  .  Let  y^  *  f(x^)  . 


x^  is  an  estimator  of  x^ 

*(Fn(x)  +  b)  ’  *  *(Fn(x)  "  b)  I  among  all  x  e  .  Then  j 

Fn  "  " 


’] 


if  it  maximizes 


estimates  y^  . 


Remark  1.1: 


izes 


l  "k  v  oo 

Define  the  set  A  =  <F  (w.  )(  .  Then,  y,  maximi: 

n  (  n  i,n  Ji-(j  'b 

,  (y  +  b)  -  -i  A{y  -  b)  ]  among  all  y  e  A  and  let  tu,  be  a  corresponding 

Fn  Fn  J 

*  * 

grid  point  such  that  y,  ■  F  (u,  )  .  Then  x,  is  defined  to  be  ou, 
a  v  ■'bn  k,n  d  k,n 


Further,  if  F  is  continuous  at  x^  and  becomes  dense  w.p.l.  in  a 

neighborhood  of  ,  it  is  easy  to  see  that  becomes  dense  in  a 

neighborhood  of  . 


2.  Consistency 
Theorem  2.1: 

Suppose  that  the  following  assumptions  hold. 


(2.A1)  In  the  neighborhood  of  x  ,  F(x)  is  continuous  and  becomes 

b  n 

dense  w.p.l. 

(2.A2)  The  assumptions  in  Theorem  II. 2. 2  hold;  i.e., 

$  .  (y)  a-Vs‘  t>  (y)  uniformly  for  0  <  y  <  1  . 

F  F  "  ~ 

n 

(2. A3)  For  all  6  small  enough,  a (6)  >  0  where 


a  (6)  ■  a 1(6)  -  a2(6) 

^(<5)  =  nin  j$p(y  +  b)  -  i>F  (y  -b)  :yb-'5<_y^yb+fij’ 
a2(5)  =  max  j'i’pCy  +  b)  -  (y  -  b)  :  0  <  y  <_  yb  -  26  , 

yb  +  26  1  y  <  l}  • 

Then 


From  Lemma  II. 2.1  it  follows  that 


Proof : 


By  Remark  (1.1),  becomes  dense  w.p.l.  in  the  neighborhood  of  . 

theorem  now  follows  from  Theorem  II. 3.1  and  Remark  II. 3.1.  || 


Theorem  2.2: 

Let  the  following  assumptions  be  satisfied. 

p 

(2.A4)  The  assumptions  in  Theorem  II. 2. 3  hold;  i.e.,  4>  *(y)  -+•  4>  (y) 

F 

for  0  <  y  ^  1  ,  n 

(2.A5)  The  probability  that  fi  becomes  dense  on  (-0D,°°)  approaches  1 
as  n  . 

Then 

(2.3) 

Proof : 

By  Theorem  II. 2. 3,  (2.A4)  implies  weak  consistency  of  ^  •  The  rest 

F 

n 

of  the  proof  is  similar  to  the  arguments  involved  in  proving  Theorem  III. 2. 


3.  Asymptotic  Distribution 


Assumptions : 


(3.A1) 

(3.A2) 


Let  (2.A4)  hold. 

For  x  in  the  interval  j^F  ^(y^  -  b)  ,  F  ^(y^  +  b) 
neighborhood  of  F  ^(y^  -  b)  and  F  ^(y^  +  b)  , 


and  in  a 


(i)  r(x)  >  0  and  continuously  differentiable,  and 

(ii)  f(x)  and  f'(x)/f^(x)  are  bounded. 


The 


Either  (2.A4)  (g(x)  is  continuous  in  x)  or  (i)  and  (ii)  imply 


(iii)  gG  ^F(x)  is  bounded. 


-1/3 

(3. A3)  a).  in  -  w.  =  o  (n  )  ,  i.e.,  ft  is  a  narrow  grid. 

i+l,n  i,n  p  n 


(3.A1)  and  (3. A3)  guarantee  consistency  of  x,  . 

D 

Since  y,  maximizes  [0  (y  +  b)  -  $  (y  -  b)]  we  have 
D  r  F 


(3.1) 


(say)  . 


Let 


(3.2) 

h  (y)  *  (y  +  b)  - 

n  r 

L  n 

<J>F  (y  -  b)  . 
n 

yb 

maximizes  h^Cy)  among  all 

y  e  A  and  hence  maximizes 
J  n 

(3.3) 

hn(y)  "  hn(yb)  =  |*F  (y  +  b) 

L  n 

-  $F  (y  -  b>l  -  K  (yb  +  b) 

n  J  L  n 

Let 

(3.4) 

6  *  y  -  yb 

(3.5) 

nl  "  yb  +  b  5  n2 

=.  yb  -  b 

(3.6) 

Ci  -  F  1(n1)  ;  C2 

-  F_1(n2) 

(3.7) 

a1  -  [ nn ! 3  ;  a2 

*  [nn23 

(3.8) 

b1  *  [n^  +  6)3  ;  b2 

-  [n(n2  +  5)3  . 

X 

n 


^1 *  *  * " * 


are  the  order  statistics  from  F  . 


Lemma  3.1: 


(3.9)  *, 


(it)  -  4f  (t)  ■  j  1F(Vi>  -  F<V 1  +  °p<n'l5) 


J-a.  j 


Proof: 


(3.10) 


*F  (t)  -  4f  (t)  ■  j  SIG-^AOHX 

n  n'  '  j=a^ 


j+1  "  V 


Vi  -  xj  -  F'lF<xj+i}  -  f_1f<V 


(3.11) 


F(X.,.)  -  F(X  )  ,  f'(C.) 

1 Toy—1 ~  -  U,V  '  F<V’  7^ 


where  ^  =  F"1(6j)  and  F(Xj}  -  9j  i  F(Xj+i)  * 


e{[F(Xj+1)  -  f<x3)]2}  ■  (-n  +  1}2(n  + 


2) 


0(n"2)  . 


Further,  the  fourth  moment  of  [F(X^+^)  ~  F (X^ ) ]  is  given  by 


E{(F<Xj+1>  -  F<X3))4}  -  ■(„  +  „  (n  +  2H„  +  3Hn  +  4)  '  0("'4) 
so  that  Var  |(F(X  ^)  -  F(Xj)]2j  -*  0  as  n  -*■  00  .  Therefore 


(3.12) 


[  F (X  )  -  F(X  )]2  =  0  (n“2)  . 

J+1  J  P 


-1  3 

By  assumption,  g[G  (j/n)]  ,  f’(^)/f  (<^)  are  bounded  for  j  c  [a^,b^  -  1] 
Therefore 


bl-i 


f'to 


(3.13)  h  l  [  F (X  . )  -  F (X  )  ] 2  - 1  -  '  _2'  '  ^  '  _1 


j=31 


J  +  1 


.  /  j  ~  -  0  (n  )  *n5  =  0  (n  5  )  . 

J  £3(tj)  p  p 
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Lemma  3.1  follows  from  (3.11),  (3.12)  and  (3.13).  j 


Lemma  3.2: 


(3 


l4) 


1 

n  +  1 


) 


+ 


6_ 

r 


r'(^) 

2r2f(?x) 


where 


with  mean 


n  +  1 


are  independent  and  exponentially  distributed  random  variables 
■  and  r  *  r^)  -  r(Cj)  . 


Proof : 


F(Xj)  and  F(X^+^)  are  respectively  the  jth  and  (j  +  l)th  order 


statistic  from  the  uniform  distribution  on  [0,1]  .  Let  S 


,  -  1  h  • 

J  i-1 


Then 


F(X.)  =  S./S  .  .  By  Strong  Law  of  Large  Numbers,  S  a+S  ‘  ^  #  From  (3.9) 
J  j  n+L  n+i 


(3.15)  ^  vi +  v’1 


6) 


V1  -i  /  v 

y  zillllMl  L  _  _L_\ 

4a  fOO  \  3+1  n+1/ 

J  1  J 


hr1  -i 

+  y  &£G.  T.Ci/n?l  — l —  +  0  (n-l6) 

/  f(Xj  n  +  1  p^  '  * 

im^l  j 


Define  Z,  by  F(Z  )  *  F  (X  )  =  j/n  .  By  Kolmogorov's  Theorem  and  the 
J  3  n  J 

fact  that  f  is  bounded  away  from  zero,  we  have 

sup  |x  -  z  |  -  0  (iT1*)  . 

VJ-V1  • 


!.<■ 


-1  -1  f,(S> 

f  Vj  =  f  A(z  )  - - 3- 


j'  *  %T  9 


f  <9 


(xj  -  v 


where  <;  lies  between  X.  and  Z  .  By  Assumption  (3.A2),  f’(C . )  /  f  (c.) 

J  J  J  J  J 


is  bounded  and  hence 


f_1(X  )  =  f-1(Z  )  +  0  (n‘S 
J  J  P 


(3.16) 


V1  -1 

V  &LG  1(J/n)] 
L 


j=a, 


t  (X  ) 


j+l 


— ) =  £ 


bl_1  g  |  G~ 1 F (Z  )"J  i 
1  J 


j+l 


-  -M 

n  4  1  / 


+  0  (n  26)  . 
P 


(3.17)  l 


hr1  -i 

_ L 


j=ai 


f(X  ) 


n  +  1 


=  ) 


b  -i  r  i 

bl  1  g[G  1F(Z  )j 


f(Z  ) 


rTT+0p("',i5) 


Expanding  in  Taylor’s  series, 


r(V  r  [  F_1  (  j  /n)  ] 


about  ,  we  get 


(3.18) 


_j _ i_  (j/n  -  n1)t,(^1)  ^  x 

r(Zj)  r(£>1)  r2(’;i)f(?1)  'n  X' 


Let 


bl-! 

=  n  L  (Yj+1  '  n  +  l) 
j=a.  '  ' 


V 


E  (A  )  =  0 
n 


Var (A  ) 
n 


b.-l  , 2  b.-l 

_1  y  (]  1  al>  .  _L  V 

2  2  '  4  L 

n  j=a1  (n  +  1)  n  j=a;L 


(j  " 


V 


1  3  -13 

~T  (nxj  •■=  o (n  5  )  . 
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Therefore 


(3.19) 


A  =  0  (n_li-63/2)  . 
n  p 


Note  that  r'(^)/r  (S^)f(C^)  is  bounded,  by  (3.A2),  and  that  in  (3.16)  and 
(3.17),  the  terms  with  (j/n  -  n^)  raised  to  a  power  greater  than  1  are 
of  a  still  smaller  order  of  n  . 

From  (3.15)  -  (3.17) 


(t)  -  \{t)  -  J|m  %  (vi  -  rrr) +  I  wj  ;rr 


+  0  (n~^6) 
P 


r(5i>  (Yj+i  ’ n  +  j-«1  r(9 n  + 


,  V1  (j/n  -  n.Jr'K.)  , 

— IT  y  - - - ± - —  +  0  (n  ^6)  by  (3.18)  and  (3 

n+lj  2/p  \ c  /  r  \  P 

■I"3!  C 


i  bl_1  /  ,  \  ,  r'(C  )  . 

r  (Vl  '  ~)  +  7  '  2r2f(5i) 


0  (n_1*6) 
P 


Replacing  subscripts  1  by  2  in  Lemmas  3.1  and  3.2,  we  get 


Lemma  3.3: 


(3.2°) 

n 


fe)  -  i  [  (y - 1— )  +  £ 

\  n/  r  \  j+1  n  +  ij  r 


r'  UJ  2 

,  6  +  0  (n  'h) 

2  _  \  P 


2r  f(52) 


.19) 
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Remark.  3.1: 

As  a  -*•  •  ,  (nyl/n  -*•  y  uniformly  in  y  and  hence  finding 
h^(y)  -  h^y^)  is  equivalent  to  the  problem  of  finding  5*6 
maximizes 


\(t)  -  \(t)]  -  ys 


Reduction  to  a  Problem  in  Stochastic  Processes 


From  Lemmas  3 . 2  and  3 . 3 


[\(y  -  *».&)]  -  -  x^} 


(3.21) 


.  1  v  (6)  -1  fr,(V  r>(C2) 

r  V01  "  2r2[  f(Cx)  ‘  f(t2) 


6 2  +  0  (n~**6) 
P 


where 


(3.22) 


»B(S)  -  vnlCS>  +  vn2(J) 


br1  V1 

(3.23)  «„« )  -  I  (lj+1  -  TTt)  :  Vn2(S)  ■  I  (-V  +  . 

J“ai  J"a2 


Let 


(3.24) 


6  -  vt 


(3.25) 


Wn(t) 


N'\ 

\  n  /  n 


(6) 


-1 


Then  t  =*  v  5  maximizes 


y^  maximizing 
which 
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(3 


.26)  Z  (t)  -  W  (t)  -  (^) 

n  n  \  n  /  o' 


1 

[•r'(5l) 

'2r2 

UJ' 

_ I 

v2t2  +  0  (6^) 
P 


Choose  v  such  that  the  coefficient  of  (-t  )  in  (3.26)  is  one,  i.e. 


/2*V*  v2p,(gl)  r,(Vl 
W  2r2Lf(5l)’  f<VJ 


1  . 


Therefore 


(3.27) 


n-1/3 


8r 


/r’ap  r*  (e2)\ 


Hence  6  *  0^(n  .  Hence  t  ■  v  ^(y^  ”  )  maximizes 


(3.28) 


Z  (t)  -  W  (t)  -  t2  +  0  (n~1/6t)  . 
n  n  p 


Lemma  3.4: 

W^(t)  is  asymptotically  normal  with  mean  0  and  variance  |t|  , 
for  all  t  . 


Proof: 

From.  (3.25),  (3.22)  and  (3.23),  W  (0)  =  0  and  E[W  (t)]  -  0  for  all  t 

n  n 

By  the  Lindberg-Ldvy  Theorem  (Cf.  Fisz  [8],  p.  197) 

(t)  \i(u)  2  n(°-  ¥) 

(f)  \2<xt)  2  4-  ¥■)  • 

Since  V^CXt) 


and 


V  „(At)  are  asymptoticallv  independent,  we  have 
nz 
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Wn(t)  ^  N(0,|t|)  for  all  t  . 

Remark  3.2: 

For  any  collection  of  t^ . t^  ,  it  can  be  shown  that  the  joint 

distribution  of  [W  (t_),  W  (t,)]  converges  to  the  multivariate  normal 

Q  X  OK 

distribution  with  mean  0  and  variance-covariance  matrix  given  by 

(d^.tjjmindt.l  ,  1 1  ^  |)) 

where 

II  if  c  and  d  are  of  the  same  sign 

0  otherwise. 

By  limiting  arguements  similar  to  Section  III. 3  or  Section  5,  Chapter  2, 
Rao  [13],  we  get 

Theorem  3.1: 

2  —1/6 

The  distribution  of  Z  (t)  *  W  (t)  -  t  +  0  (n  t)  converges  to  the 

n  n  p 

2 

distribution  of  W(t)  -  t  where  W(t)  is  a  two-sided  Wiener-Levy  process 

with  mean  0  and  variance  1  per  unit  t  and  W(0)  =  0  . 


The  Asymptotic  Distributions  of  y^ 


Theorem  3.2: 


The  asymptotic  distributions  of 


(3.29) 

v'1(j,b  -  yb 

(3.30) 

‘‘‘K  ■  *b 

have  density  <i(t)  where  i  is  the  density  of  the  value  of  t  maximizing 


9 


Z(t)  -  W(t)  -  t2 
E[W(t)]  -  0  and 


W(t)  is  a  two-sided  Wiener-Lfevy  process  with  W(Q)  ■  0 
Var  [W(t)3  -  |t|  ,  for  all  t  where 


v 


1/3 


W^)  r’(C2)\2 


(3.31) 


Proof; 


Since  t  *  v”  (y^  -  y^)  maximizes  ZR(t)  and  by  Theorem  3.1, 
ZR(t)  5  ^.(t)  ,  we  only  have  to  show  that  the  assumption  on  grid  points, 
viz.  o).._  _  -  ■  o  (n  ,  is  necessary. 

ItJmiQ  x  |Q  p 

Since  t  »  v  ^(y  -  y^)  with  y  e  , 


F  (u». .  i  )  -  F  (w.  ) 

_  n  i+l.n _ n  l,n 

1+1  i  v 


^  0  if  u,  .  -  u).  ■  o  (n  . 

i+l,n  i,n  p 


Proof  of  (3.30)  and  (3.31): 


*b  -  *b  ■  FnW  -  FK) 


Fn(*b)  -  F(’S>  +  (*b  '  *b)fU) 


where  c  lies  between  and  x^ 


(*b  "  xb)f(0  "  (yb  ‘  yb)  +  °p(n"ii)  * 


by  Kolmogorov’s  Theorem.  Since,  x^  -*•  x^  and  f(x)  is  continuous  at 


S'' 


•  f(0  ^  *[\)  by  Corollary  2  to  Theorem  5.1,  Billingsley  (3].  Hence, 
by  Slutsky's  Theorem  (Cf.  Cramer  16),  p.  254),  we  get 

v‘lfK)(xb  -  >0 5  v~l6  • 


Let  X  * 


xi/f^x^)  and  the  theorem  follows. 


An  Alternate  Definition  of  the  Pseudo  Change  Point 


* 

*b  “ 


The  pseudo  change  point  may  be  alternately  defined  as 
.  L\  .  --l/yK  .  Dj 

where  y^  maximizes  ‘^(y  +  b)  -  I1  (y  -  b) 


F'i(;b  +  b)  +  F-l<;b  -  k) 


Let  be  any  set  in  [0,1]  and  containing  the  points  0  and  1  . 

- 


Then  )  is  said  to  estimate  x^  when  y^  maximizes 

*(y  +  b)  -  ♦  .(y  -  b)l  ,  where  y  is  restricted  to  A 

Fn  Fn  J 

Under  regularity  conditions  similar  to  those  in  Section  2,  it  can  be 

*  *  *  * 

shown  that  y^  and  are  consistent  estimator  of  y^  and  x^  respect¬ 

ively.  Further,  it  can  be  shown  that 


+  f<v) 


-1 


■1  /  *  * 


K  -  0 


has  density  i{»(t)  where  v  and  V  are  defined  in  Theorem  3.2. 


Remark  3.3: 


If  b  satisfies 


F'l(yb  +  b)  +  -  b) 


x  and 
a 


F_1(yh  +  b)  -  F'l(y.  -  b) 


-1/ 


,  where  a  and  x  are  as  defined  in  Chapter 


III,  then  it  is  clear  that  x^  and  are  asymptotically  equivalent. 
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CHAPTER  VI 

NARROW  WINDOW  ESTIMATORS  BASED  ON  THE  ♦  TRANSFORMATION 

* 

1.  The  Estimator  x^ 

_  B 

A  natural  window  estimator  of  l/r(x)  ,  using  the  $  transformation  is 
given  by 


*('>  +  bn)  -  *  *(rn<x>  '  \) 


(1.1) 


r*<*> 

Q 


2b 


where  2b  is  a  narrow  window, 
n 

Definition: 

xq  la  said  to  be  the  change  point  if  it  maximizes  l/r(x)  .  Let 
y0  "  F(xo)  • 

*  -  * 

x^  is  said  to  estimate  xq  if  it  maximizes  1/r  (x)  among  x  e  . 
n 

A  £  /*  \  it  OO 

Let  y.  -  F  ixl  1  and  A  ■  /f  (w.  )l 

\  °\\)  "  in  1,n  fl*0 

We  aball  obtain  the  analog  of  the  results  in  Chapter  IV  and  this  will 

enable  us  to  obtain  the  asymptotic  efficiency  of  x  relative  to  x^  . 

n  n 

2.  Strong  Consistency 
Let  6  >  0  and 

»,«>  -  «ln  :  xo  -«<.»<.  xq  +  «} 

0^(6)  »  max  :  s1  <  x  ^  xq  -  26  ,  xq  +  26  ^  x  <  s2  | 


a  (6)  -  a^J/a^) 


Theorem  2.1; 


If 

A  /  too 

(2.A1)  either  F  =  F  or  the  grid  Jw.  I  becomes  dense  w.n.l.  on  the 
n  n  \  i»n|i-0 

It  d  s  • 

^  1+1, n  i,n'  ’ 

(2.A2)  becomes  dense  w.p.l.  In  the  neighborhood  of  xq  ; 

(2. A3)  the  support  of  F  Is  an  Interval  and  F  has  a  uniformly  continuous 
density  f  ;  and 

(2.A4)  for  all  <5  small  enough,  a(S)  >  1  , 
then 

(2.1)  y  a+8*  y  and  x  a+Sl  x  . 

b  o  b  o 

n  n 

Proof: 

Let 


(y  +  b  )  -  $  *(y  -  b  ) 


n 


hn<y> 


2b 


Fn  (y  +  bn^  "  Fn  (y  “  bJ 

n  n  n  n 


2b 


-g 


G_1S(y) 

n 


where 


Tl  -  V  i  F„  ' 'B„w>  i F*  1(-y +  V  ■ 


i.e.  , 

(2.2)  y  *  bn  1  Sn(y)  1  y  +  bn  . 


Clearly, 
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(2.3) 


Bn<y)  V  y 


uniformly  in  y  .  Let  X^,  ••••  xn  the  order  statistics  from  F  .  Then, 


^  £  Y^  and  Y^,  Y^^  are  independent  random 

variables  and  have  exponential  distribution  with  mean  1/ (n  +  1)  . 


F(X.)  ■  t -  where  S 

1  Sn+1 


.-1 


F  (y  +  b  )  -  F  (y  -  b  )  -  X.  .  j.  v,  -  X,  /  .  v.  +  0(w  ) 
n  '7  n'  n  7  n'  fn(y+bn)]  (n(y-bn>]  n' 


*  i  ,  * 

where  w  ■  0  when  F  =  F  and  w  ■  sup  w...  -  w.  when  F  t  F 

n  n  n  n  i  i+l>n  i,n'  n  n 

By  (2.A1),  in  the  latter  case,  w  a48,  0  . 

n 


*-!  J  [n(y+b  )]\  ,/  [n(y-b  )] 

F  (y  +  b  )  -  F„  (y  -  b  )  -  F  M - 5 - — )  -  F  ^ 5 - ~ |  +  0(w_) 


n 


n  n 


n+l 


n+l 


where 


S[n(y+b  )]  "  S[n(y-b  ) ] 

- S— - - - - - -  +  0(w  ) 

n+l  f (f  Yn(y) ) 


[n(y-b  ) ] 


n+l 


1  Yn(y)  1 


' [n(y+b  ) ] 


n+l 


By  proof  along  the  lines  of  Venter  [18] ,  it  can  be  shown  that 


(2.4) 


3  S  • 

Y  (y)  *  y  uniformly  in  y 

n 


and 


S[n(y+tn)]  ~  S[n(y-bn)l 

2b  1 


(2.5) 


uniformly  in  y  . 
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By  (2.A2),  w.p.l.  3  nQ  9  for  all  n  nQ  ,  3  an  Integer  satisfying 

|u>.  -  x  |  <  6  and  for  which  |F  /w.  \  -  y  |  <  c  for  some  e  >  0  .  For 

Vn  0  nl  n,n/  0 

a 

n  ■  n  ,  define  x  ■  w,  and  y  ■  F  (x  )  . 
o  o  k  .n  o  n  o 


hn(y> 

[S(n(y+bn)]  ”  S[n(y-bn)J 

1 

f(F'\(y)) 

-  +  0(w  ) 
n 

g 

,°‘l6„<y) 

zr 

a 

v; 

0 

1 

*  1 1 

Sln(yo+bn)J  '  StnCyo-bn>] 

1 

*(F_lv„<y0> ) 

-  +  0(w  )  g 
n 

°‘*W 

hn(y)  S[n(y+bn)]  S[n(y-bn>]  f(F  Nn(yo))  f(F  ^(y)) 

hn(>,o>  S[n(y„+I>n)]  '  S[n(yo-bn)]  f (F_1Yn(y) )  f (F‘lBn(yo>) 


r(F"Vyo>) 

•  *  "■  *  1111  . 

r(F_16n(y) ) 


+  0(w  ) 
n 


Choose  j  9  y  1.  f(xq  -  36 )  or  y  >_  f(xq  +  36  )  .  From  (2.3),  w.p.l. 
3  i  n0  independent  of  y  9  for  all  n  n^  ,  6R(y)  ^  f(xq  “  2(^) 

or  8^ (y)  >_  f(xq  +  2d)  .  Hence  for  all  n  >_  n^ 


(2.7) 


F_10  y  1 
n7oJ 


F'V 


a2(6) 

a^(6) 


1 

a(6)  • 


From  (2.3),  (2.4),  (2.5)  and  uniform  continuity  of  f(x)  ((2. A3)),  w.p.l. 
3  nj  2.  ni  independent  of  y  9  for  all  n  >_ 


(2.8) 


S[n(y+bn)]  S[n(y-bn)] 

1 

e 

XI 

(M 

_ 1 

S[n<yo+bn)]  "  S[n(yo-bn>3 

L  2b 

l-  n 

J 

f(F‘\M  £(f'\<f)) 

“tti - r  *  t^i - r <  a(6) 

£(F  Bn(y0>)  f(F  sn(y0)) 


and,  hence,  from  (2.6)  -  (2.8), 


57 


h  (y) 

<2‘9>  \Fo>  *  a(6>  +  °(Wn>  ’ 

If  vn  *  0  ,  i.e.,  ?n  i  Fq  ,  w.p.l.  3  independent  of  y  )  for 

ell  n  >_ 

a(6)  +  0(w  )  <1 
n 

end  from  (2.9) 


h  (y) 

_U _  < 

h  (y  ) 
n  J  o 


1  . 


A 

But  yb  maximizes  hQ(y)  => 
n 

w.p.l.  Since  6  is  arbitrary 


Hence  f(xq  -  36)  <  <  f(xq  +  36 

n 

.  By  Lemma  II. 2.1  x^  al8,  xq  .  |  | 

n 


3.  Asymptotic  Distributions 
Assumptions: 

(3.A1)  Conditions  (2.A2)  and  (2. A3)  hold. 

(3.A2)  In  the  neighborhood  of  xq 

(I)  r(x)  is  thrice  differentiable,  and 

(II)  f* (x)/f^(x)  is  bounded. 

Note  that  min  r(x)  -  r(xQ)  <  *  implies 
(lii)  gtG_1F(x)]  >  0  . 

1/8  <  a  <  1/5  . 

n  /  . 


(3. A3)  b  -  An  ;  A  >  0  , 


(3.A4)  Ul+l  n  -  »1>B 


,( 


minimizes  r(x)  ->  r'(x  )  "  0  .  As  in  Section  V.3,  define 


6  -  y  -  y 


n,  ■  y  +  b 
1  7o  n 


5  n2  "  ^0  -  bn 


-  F"1(n1)  ;  C2  -  F_1(n2) 


-  [on1l 


;  a2  -  [nn2] 


■  [n^  +  5)]  ;  b2  -  [n(n2  +  6)] 


Lemma  3.1: 


(3.1) 


k&)  •  \^}  -  •  7(xj  k  ( Vx  -  rh) 


l  K+1  +  TTi) 

)-a2 
:"(x  )b 

'  o  >  n _  .2 

<W*0) 


+  0  (6b3  +  63b  ) 
p  '  n  n  ' 


where 


ME 


are  independent  and  identically  distributed,  having  the 


exponential  distribution  with  mean  l/(n  +  1)  . 


Proof: 


From  Lemmas  V.3.2  and  V.3. 3 
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(3.2) 


/M  _  111)  .  1  by  1  /Y  _  1  \  6  _  I‘,U1) 

i  n  V  n'  r(V  J-f-1  J+1  n  +  1*  r(V  2r2(t1)f(f,1) 


+  0  (n'^i) 
P 


(3.3)  *p_(y  -  ♦,  ft)  ■  ^  ^  (-V1  +  rh ) 


5  r*  ^2 

r(52)  2r2(C1)f(£1) 


+  0  (n'^5)  . 

P 


From  Taylor  Series  expansion 


(3.4) 


b2  .0  (b3)  . 

..  \  2 /  \,2/_  \  n  p\  n/ 


F  (yoibn)  r(Xo)  r  (x0)f  (xo> 


The  lemma  is  immediate  from  the  above  relations. 


Reduction  to  a  Problem  in  Stochastic  Processes 


b.-l 


Let.  V 


n  +  l)  +  J-  (“YJ+1  +  n  +  l) 
j-a2  J 


maximizes 


V  (6)  r"  ( x 

n _ _ '  o 


"W_  ,2  ,  „  /PL 3  ,  r3. 


-  .  ?  r  ■  52  +  0  (6b3  +  53b  )  . 

2/  \ -2/..  \  pv  n  n' 


r(xo)  r2(x0)f  (Xo) 


(0  \  "*  *  A  «  A 

— )  V  (5)  .  Then  t  -  v  6  maximizes 
n  /  n 


(3.5)  Z  (t)  -  V  <t)  -  (•— )  »V  +  0  (5>5.nli'3a  +  S5/Z-nH'a) 

a  n  °  *WfW  p 


*0 


Choose  v 


such  that  the  coefficient  of 


(-t2) 


in  (3.5)  is  one,  i.e., 


Therefore 


(3.6,  v  -  2l/3A-2/V/3(-  )c2/3(;  )t„-2/3(- 


l-2a 

3 


Therefore,  6  «  0 


Hence  t  ■  X 


*(\ '  y°) 


maximizes 


(3.7) 


Z  (t) 

n  n 


2  i-^) 

W  (t)  -  t  +  0  \n  t / 


Lemma  3.2: 

W  (tr)  is  asymptotically  normal  with  mean  0  and  variance  min(|t|,2B)  , 
n 

for  all  t  where 


(3.8) 


B  -  lim  — 

v 

n-*=° 


Proof: 


Note  that  W  (0)  -  0  and  E(W  (t)]  ”0  for  all  t  .  By  a  straig'nt- 
n  n 

forward  but  tedious  calculation  (Cf.  Venter  [18]),  it  can  be  shown  that 


(3.9)  Cov  |wft(t)  .WQ(t*)|  -  4  {min(  j  t  [  ,2B)  +  min(|t  -  t*|)  -  mi.i(|t  -  t  |, 


2B) 


In  particular,  for  t  ■  t  , 
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(3.10)  Var  [Wn(t)J  *  tain(|t |  ,2B)  . 

Since  all  the  conditions  of  La' unov  Theorem,  p.  203,  Fisz  ['£],  are  satisfied, 
the  lemma  follows.  |  | 

Remark  3.1: 

The  distribution  of  W  (r.'  tends  co  a  C Russian  process  with  mean  0 

n  r 

and  variance-  ariance  function  given  by  (3.0)  and  hence,  by  an  application 

of  Slutsky* s  Theorem, 

2  (t)  5  Z't)  *  W(t)  -  t2  . 

n 

A  A 

The  Asymptotic  Distribution  o  and 

_ _n _ n 

Theorem  3.1: 

The  random  variables 

(3.11)  v_1/vb  -  v 

\  n 

(3.12)  -  *,) 

\  n  / 

are  asymptotically  distribute.)  as  the  variable  t  which  maximizes 

Z(t)  -  W(t)  -  t2  where 

(i)  for  a  ■  1/5  ,  W(t)  is  a  Gaussian  process  with  W(0)  *  0  , 

E(W(t))  -  0  for  a.i  t  and  covariance  function  given  by  (3.9);  and 

(ii)  for  1/8  <  a  <  1/5  ,  W(t)  is  a  two-sided  Wiener-Ldvy  process 

with  W(0)  ■  0  ,  L[W(t)]  «  0  for  all  t  and  variance  1  per 


unit  t 


X  =  v  /  f  (  x  )  with  v  is  defined  in  (3.6)  and  ft  has  to  satisfy  (3.A4) 
'  o  ;  n 


Proof: 


ti+l  "  *1 


f  vt»)  .  )  -  F  (w.  )  D 

t.  i+l,n _ n  1  ,n  P 


0  for 


Wi+l,n  "  “i,n 


Also,  for  a  <  1/5  ,  B  *  °°  and  hence  W^(t) 


tends  to  a  two-sided  Wlo  .e'  process  for  1/8  <  ct  <  1/5  .  t 


"(\  ‘  y°) 


maximizes  Z  (t)  and  sir.  a  Z  (t)  ■+  Z ( t )  ,  (3.11)  is  immediate. 

r>  n 


Proof  of  (3.1 ?) . 


y.  -  y  *  F 
Jb  o 


i,K  )•  fK> 

\  n  / 

■\\)  -  fO + (\  •  ^)f<° 


where  c  lies  between  x.  and  x  .  Therefore 

a  o 

n 

^y^  -  >*oj  +  0^(n  ^  '  b>*  Kolmogorov's  Theorem, 


(\  *  ‘°)fU> 


a .  s .  a .  s . 

-►  x  =>  r,  -*•  x 
o  o 


and  the  result  follows  from  Slutsky's  Theorem. 


Remark  3.2: 

For  the  special  case  of  estimation  of  the  mode  of  a  density,  the  above 
theorem  re  duces  to  Theorems  3a  and  3b  of  Venter  [18].  It  is  interesting  to 
note  that  in  all  the  four  estimators  discussed,  for  the  fixed  (narrow) 
window,  the  grid  is  required  to  be  narrow  (wide). 


4,  Asymptotic  Frficiony  of  Narrow  Window  Estimators 

In  this  section,  we  obtain  the  asymptotic  efficiency  of  x  relative  to 

3 

n 

*t  • 
n 

it 

Let  Z  (t)  avid  i  (t)  be  two  consistent  estimators  of  Z(t)  such  that 
r*  i 
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(4.1)  nY(zn(t)  -  Z(t) )  5  Hx(x) 
and 

(4.2)  nY(z*(t)  -  Z(t))  5  H2(x) 

for  some  y  >  0  ,  where  ,  H2  depend,  in  general,  on  Z(t)  . 

Definition; 

Kolmogorov-Smimov  distance 

(4.3)  d[H1(x) ,H2(x)]  «  sup  |Hi(x)  -H2(x)|  . 

— ®<X<“ 

Followi  j  Hodges  and  Lehmann  [  9  ],  we  define  the  asymptotic  efficiency 
-  * 

of  Z  (t)  and  Z  (t)  as  follows: 
n  n 

Definition: 

-  * 

The  asymptotic  efficiency  of  ZR(t)  relative  to  Z^(t)  is 

(4.4)  e(z  (t),Z*(t))  «  a2n 

'  n  n  '  o 

where  a  satisfies 
o 

(4.5)  inf  d[H1(x),H2(x/o)]  -  d[H1(x),H2(x/oo)]  . 

a 

In  particular,  if  H^(x)  ■  H(o^x)  and  H2(x)  =■  H(o2x)  ,  then  it  easily 
follows  that 


a 

a 


(4.6) 


•(Vt>>Zn(e)) 
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If  e(z^(t) ,Z^(t) )  *  1  ,  the  two  estimators  are  said  to  be  asymptotically 
equivalent.  From  Theorems  IV. 3.1  and  Theorem  3.1,  by  definition  (4.6), 


(4.7) 


Remark.  4.1: 

If  we  choose  A  =  Cf(xQ)  +  0^(n  Y)  for  some  y  >  0  ,  it  can  be  easily 
seen  that  the  two  estimators  are  asymptotically  equivalent  for 

y  >  and  1/8  <  a  <_  1/5  . 
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CHAPTER  VII 

OTHER  ESTIMATORS  AND  COMPUTATIONAL  ASPECTS 


1.  Other  Estimators 


1.1  The  Naive  Estimator 


(1.1) 


*n(x)  * 


f‘(x) 


g 


[‘-1 


-1  * 


F*(x  +  a  )  -  F*(x  -  a  ) 
n _ n _ n _ rt 

2a  ‘g  [g_1F*(x) 
n  n 


is  called  the  naive  window  estimator  of  r(x)  and  x^  minimizing  r^Cx) 
estimates  the  change  point  xq  . 

Under  the  conditions  of  Theorem  IV. 2.1,  it  follows  from  that  theorem 


that  x  is  a  strongly  consistent  estimator  of  x  .  Furthermore,  if  the 
n  o 

assumptions  in  Section  IV. 3  are  satisfied,  it  can  be  shown,  by  a  proof 

similar  to  the  proof  of  Theorem  IV. 3.1,  that  x  and  x  have  the  same 

’  n  a 

n 

asymptotic  distribution,  i.e.,  they  are  asymptotically  equivalent. 


1.2  A  Family  of  Estimators  of  the  Generalized  Failure  Rate  Function 
and  the  Change  Point 

To  estimate  the  unknown  generalized  failure  rate  function  r(x)  , 
consider  statistics  of  the  form: 

OD 

u.a>  ^  j 

and 


r*<*> 


_1_ 

b 

n 


kA-  ^  u\d$  A(u)  ,  at  x 
\  n  /  Fn 


(y) 


(1.3) 


•  o 

where  K(x)  is  a  certain  density  function  and  a  ,  b  tend  to  0  as 

n  n 

n  -*■  09  .  When  G  is  the  uniform  distribution  on  [0,1]  ,  (1.2)  reduces  to 
the  statistic  considered  by  Nadaraya  [11],  Parzen  [12]  and  others  for 
estimating  a  density  function  and  mode.  Note  that  when 

I  u  |  <1 

elsewhere 

we  get  the  estimators  considered  in  Chapters  IV  and  VI.  One  can  now  define 
estimators  of  the  change  point  with  respect  to  the  smoothing  function  K.  . 

It  would  seem  possible  to  obtain  the  analogue  of  the  results  of  Nadaraya 
and  Parzen  to  this  more  general  case. 

1.3  Estimation  of  the  U-Shaped  Generalized  Failure  Rate  Function 
and  the  Change  Point 

Suppose  we  know,  apriori,  that  r(x)  is  U-shaped.  Using  the  approach 

of  Barlow  and  van  Zwet  [1,2],  estimators  are  suggested  for  the  change  point. 

* 

In  this  subsection,  we  assume  the  case  of  complete  sample;  i.e.,  Fn  =  Fr  . 

Assume  initially  that  u,  <  x  <  u.  for  some  k  .  Let  r  be 

J  x,n  —  o  Ht+l.n  n 

an  initial  or  basic  estimator  for  r  and  x  minimize  r  .  Consider  the 

n  n 

following  regression  of  r  with  respect  the  discrete  measure  u  : 
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(1.5) 


rn(x,k)  * 


t-1 


sup  inf 
k+l>t>i+l  s<i 


J  r  (go.  )u  {to.  } 

n  j.n  n  j,n 

t-1 

l  V  (w,  > 

J-s  n 


CD.  <  X  <  CD.  - 

i,n  —  i+l,n 


i  ■  0,1,  ....  k-1 


I  n)Vl  _) 

.  .  1-S  j’  j* 

inf  J - : - 


<  x  <  UlSaSL + 


s<k 


y  p  (w.  } 

. L  n  1  ,n 
j-s  J  ’ 


^kjn  — 


t-1 

y  r  (Mj  )M  {UK  } 

.  .  1-k  “  J'"  "  3’n  V/Vu 

inf  r— : - — * - r - *—  <  x  <  co, 


t>k+l 


t-1 


l  r  (u  _>P  (w  _> 
j-k  J,n 

t-1 

I  r„(U4  n)P_  {w.  } 
j.,  n  J.n  «  J.n 

inf  sup  ^ - — : — - 

t>i+l  k<s<i  r  ,  , 

~  -  I  u  lw,  nJ 

i->  “  1>n 


k+l,n 


CD.  <  X  <  CO,  ... 

i,n  —  i+l,n 


i  »  k+1 ,  ... 


Not«  that  r  (x,k)  is  a  step  function  and  decreases  till  go.  and 
n  ic  |  n 

increases  after  n  •  The  following  criteria,  for  example,  may  be 

A  A 

chosen  to  obtain  the  optimum  value  of  k  ,  viz.  k  =  k  (n)  . 

,  A  A 

(i)  Choose  k  ■  k  such  that  k  minimizes 


sup  | r  (x,k)  -  r  (x) j 
x 


,  x  *  * 

(ii)  Choose  k  -  k  such  that  k  minimizes 


l  n,k)  "  rn(ui  r?  ^  ' 

t0  n  *  |H  n  x )  n 


68 


Note  that  k  is,  in  general  not  unique.  While  one  could  modify  the 

* 

definition  to  make  k  unique,  this  will  not  be  necessary,  since  these 

Intervals  typically  all  lie  within  a  range  which  is  small  compared  to  the 

* 

variability  of  k  .  Then 


(1.6) 


* 

x 

n 


,n 


k*+l.n 

2 


estimates 


Barlow  and  van  Zwet  suggest  the  following  basic  estimators  rR  and 

discrete  measures  y  : 

n 


r  (x) 


Fn(Vlin>  ~ 


"  “4  «>8 


14-1, n  1  ,n  n  1  J 


c_1r_(cj 


(1.7) 


“i,n  -  *  <  "l4-l,n 
*1  -  H(wi>n  4-  Vlin) 


*  <“141. n  *  “l,n)*[°‘lrn<£l)]  • 


Call  the  estimator,  obtained  from  substituting  (1.7)  in  (l.S),  r  (x,k)  . 

ft 

For  the  case  of  complete  sample,  u.  -  X,  for  all  1  ,  G  assumed  to  be 

X  ,n  l 

* 

the  exponential  distribution  with  mean  1  and  k  chosen  to  maximize  the 

* 

likelihood  of  the  sample,  r  (x,k  )  is  the  same  as  the  maximum  likelihood 

fl 

estimator  of  a  U-shaped  failure  rate  function  considered  by  Bray,  Crawford 
and  Proschan  [4], 


(1.8) 


r  (x)  as  defined  in  (1.7) 
n 

“.'"i.o'  •  “141.0  -  "l.o 


and  substituting  (1.8)  in  (l.S),  we  get  r*(x,k)  ,  the  corresponding 

n 

"smoothed"  estimator. 
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G  XF  (w,  )  -  G  LF  (u.  ) 

r  (x) _ EL-i±L-D _ !L  JLiS_ 

n  w...  -  to. 

i+l,n  i,n 


U),  <  x  <  «.±1 

i,n  —  i+l,n 


(1.9) 


u  {oj.  }  -  0).,.  -  (0. 

n  i,n  i+l,n  i,n 


and  rn(x,k)  is  obtained  by  substituting  (1.9)  in  (1.5). 


Let  I 


u  *  * 


.  Based  on  the  results  of  Barlow  and  van 


L  k  ,n  k  +l,n 
Zwet  [2],  we  make  the  following 


Conjecture: 

If 

(1.A1)  xq  is  unique; 

(1.A2)  r  is  continuously  differentiable  and  f"  exists; 

(1.A3)  r'(x)  <  0  for  x  <  x  and  r'(x)  >  0  for  x  >  x  ; 

o  o 

(l.AA)  r  (x)  is  a  consistent  estimator  of  r(x)  ;  and 
n 

(1.A5)  to.,,  -<o,  »cna  0<a<  1/3  and  c  >  0  , 

i+l,n  i,n 


then 


(1.10) 


lim  P 

n-H» 


0 


(1.11)  lim  P|supA  |r 

n-*=°  Ix/I^ 

V  "  X  ~ 

where  rR(x,k)  is  equal  to  rR(x,k)  or  rn(x,k)  or  r^(x,k)  . 

Analogous  to  the  estimator  based  on  total  time  on  test  measure  given 
in  Section  5,  [2],  we  can  define  the  following  basic  estimator  and  discrete 


measure: 


1 


7(1 


VviJ  ~  ^S.,1 

4F  lF„(Vl,»»  -  *F  'F„K,n>l 
n  n 


0).  <  X  <  W.  L, 

i ,n  —  i+1 ,n 


(1.12) 


y  {u.  } 

n  i,n 


>F  <F„<"1.1,„>1  - 

n 


F  ‘F„<“l. 
n 


.)] 


Thus  any  one  of  the  four  basic  estimators  suggested  above  may  be  used 
to  estimate  r(x)  and  x^  .  Mathematical  analysis  of  such  estimators  of 
the  change  point,  obtained  from  smoothing  a  basic  estimator  of  r(x)  and 
based  one  of  two  criteria  suggested  above,  seems  intractable  to  obtain 

meaningful  asymptotic  results.  Computational  results  are  inconclusive  to 

\/ 

suggest  that  any  one  criterion  or  any  one  version  of  rn(x,k)  is  superior 
to  the  rest. 


1.4  Estimation  of  the  Change  Point  -  The  Case  of  Incomplete  Data 

Items  on  test  may  possibly  be  of  different  ages.  Further,  an  item 
may  be  removed  from  test  by  one  of  two  ways  -  failure  or  truncation.  Truncation 
is  the  action  of  summarily  removing  an  item  from  test.  Truncation  times  may 
or  may  not  be  known. 

In  this  case,  the  maximum  likelihood  estimator  of  F  ,  when  no  assumptions 
are  made  concerning  the  distribution,  has  been  obtained  by  Kaplan  and 
Meier  [10].  This  can  be  used  to  estimate  the  and  transformations 

and  hence  the  change  point. 


2.  Computational  Aspects 
2.1  Recommendations 

We  shall  restrict  ourselves  to  the  strongly  consistent  estimators 

x  and  x^  ,  discussed  in  Chapters  IV  and  VI  respectively.  In  order  to 

n  n 
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correspond  to  the  asymptotic  theory  developed  earlier,  the  windows  are 

required  to  satisfy  the  relations:  -  Cn”a  ,  bn  -  An"*a  ,  where  A  ,  C 

l-2a 

3 

and  a  are  positive  constants,  u .  , ,  -  w.  ■  cn  ,  for  all  i  and 

r  i+l,n  i,n  ’ 

c  a  positive  constant,  is  a  convenient  choice  for  the  grid  fi  and 

n 

u)g  n  is  determined  by  the  left  end  point  of  the  support  F  . 

(1)  Choice  of  a  : 

/v 

The  estimator  r^(x)  defined  in  Chapter  IV  is  asymptotically  the  same 

as  the  basic  estimator  defined  in  (1.9).  Barlow  and  van  Zwet  have  shown 

that  if  r(x)  is  twice  differentiable,  the  mean  square  error  of  the  basic 

extimator  is  minimized  for  a  -  1/5  (Cf.  [2],  p.  7).  Hence  a  *  1/5  is 

recommended.  For  this  choice  of  a,  /x  -  x  \  ■  0  (n  and 

\  a  o  I  p 

-  \  -1/5  '  n  ' 

x„)  -  0  (n  1/5)  . 

o  p 


(2)  Choice  of  c  : 

By  Theorems  IV. 3.1  and  VI. 3.1,  ft  must  satisfy  the  condition, 

(-if) 

a).  -  ui.  ■  o  \n  /  for  all  i  .  For  a  *  1/5  ,  this  reduces  to 

l'Tx ,  n  1 ,  n  p 

the  condition  -  a>,  ■  o  (n  for  all  i  ,  which  may  be  satisfied 

i+l,n  i,n  p  *  1 

in  practice  by  choosing  c  less  than  both  A  and  C  . 

(3)  Choice  of  A  and  C  : 

The  preference  of  one  narrow  window  estimator  over  another  as  well  as 
the  "optimal"  values  of  A  and  C  depend  on  the  particular  distribution 
function,  which  is  of  course  unknown.  However  on  the  basis  of  Monte  Carlo 
simulations,  some  important  conclusions  are  noteworthy  for  estimating  the 
change  point  of  probability  density  and  failure  rate  functions. 
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(i)  x  was  noted  to  be  sensitive  to  the  choice  of  C  for  small 
a 

n 

samples  (up  to  3000).  Improper  choice  of  C  could  lead  to 
estimates  of  x^  and  r(xQ)  well  away  from  the  true  values. 

were  seen  to  be 


(ii)  In  contrast  to  the  above,  x^  and  r  /x^  j 

n  \  n  / 

very  good  estimators  if  the  criterion  is  to  minimize  the  maximum 
error.  Furthermore,  they  were  relatively  insensitive  to  the 
choice  of  A  .  It  should  be  noted  that  a  check  has  been  built 
into  the  computer  program  to  reduce  the  value  of  A  if  it  is 
found  to  be  large.  It  has  not  been  possible  to  include  a 
corresponding  check  for  C  . 


Hence,  though  x  and  x^  are  strongly  consistent  (under  the  assump- 

n  n 

tions  in  Chapters  IV  and  VI),  the  estimator  based  on  the  4  transformation 
is  recommended  for  small  samples. 


2.2  Numerical  Results 

Monte  Carlo  simulations  were  conducted  in  the  following  two  cases: 

(i)  change  point  (mode)  of  the  N(0,1)  density  (Table  2.1); 

(ii)  change  point  (maximizing  point)  of  the  failure  rate  of  a  parallel 
structure  composed  of  two  independent  components  having  exponential 
failure  distributions  with  mean  lifetimes  %  and  1  (Table  2.2). 


In  Tables  2.1  and  2.2,  for  each  sample  size  n  ,  values  computed  from 
the  $  transformation  are  given  below  the  corresponding  values  from  the  $ 
transformation.  These  estimates  are  the  average  of  values  obtained  in  25 
simulations;  there  was  no  significant  variation  in  the  results  when  the 
number  of  simulations  was  increased.  Estimates  were  obtained  in  both  cases 
for  a  number  of  values  of  A  and  C  .  In  case  (i) ,  A  was  chosen  to  make 
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the  tvo  estimators  asymptot  cally  equivalent  (i.e.,  A  *  Cf(xQ))  .  Simula¬ 
tions  were  conducted  in  both  cases  for  u  ranging  from  50  to  3000.  Some 
typical  results  are  shown  i;i  the  table  -. 

Several  numerical  inver. -igations  for  estimating  density  and  failure  rate 
functions  have  been  conducted  by  Watson  and  Leadbetter  [19]  and  [20].  They 
obtained  the  best  results,  n  the  t-ase  of  estimating  a  failure  ratw  function, 
from  a  "heuristic  graphical  estimator'’  (Cf.  [19],  p.  180).  To  obtain  this 
estimator,  -log  [1  -  Fq(x);  is  plotted  against  x  and  a  smooth  curve  is 
drawn  through  the  points  by  any  reasonable  method.  The  slope  of  the  curve 
at  any  point  x  ,  say  r  (xl  ,  estimates  the  failure  rate  at  that  point. 

Since  -log  [1  -  Fq(x)]  is  infinite,  for  x  equal  to  the  last  observation, 
no  interpolation  is  possible  between  (n  ••  l)th  and  nth  sample  points.  The 

change  point  can  now  be  est  ’mated  by  determining  the  point,  say  x  ,  (not 

8 

A 

necessarily  unique)  at  which  r  (x)  is  minimum.  This  estimator,  by  its 

8 

construction,  does  not  come  vith  formulae  for  its  mean  and  variance. 

The  computer  program  was  also  applied  to  actual  life  data  on  two  types 
of  very  expensive  radar  tubes.  The  data  was  in  the  form  of  failure  times  of 
19  tubes  of  type  1  and  25  ubes  of  type  2.  In  each  case,  the  change  point 
was  also  estimated  graphically  (Figure  2.1)  and  the  results  are  summarized 


in  Tables  2.3  and  2.4. 


The  numerical  investigations  were  carried  out  on  a  CDC-6400  computer 
at  the  Computer  Center,  University  of  California,  Berkeley  The  execution 
time  for  the  case  mentioned  above  was  approximately  30  seconds  for  each 
tube  type. 

Details  of  the  computer  program  are  given  in  the  Appendix. 
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TABLE  2.1 


ESTIMATION  OF  THE  MODE  OF  THE  N(0,1)  DENSITY 


F  (x) 


—  CO 


—oo  <  x  <  00 


r (x)  -  f (x) 


j  -x2/2 
____  e 


x  =  0.0 
o 


0.398916 


A  - 


i.e.  , 


a  =  1/5 

Number  of  Simulations  =  25 


c  =  1/4 


—oo  <  x  <  00 


MEAN  VALUE 

MEAN  SQUARE 

’  MEAN  VALUE”'" 

mean'  square” 

X 

X 

r  /x  \ 

r  /x  \ 

a 

a 

nl  3n  / 

nl  an  / 

n 

C 

OF  n 

ERROR  OF  n 

OF  ' 

ERROR  OF 

A 

A 

*r  \ 

*r  \ 

Xb 

*b 

rn  K 

r.K 

-  .  _n.  _ 

n 

\  n  / 

.  -  ,  V  nj, 

50 

n  /. 

-0.028814 

0 . 830221E-03 

0.605723 

0.427688E-01 

u  •  *4 

0.094659 

0 . 896029E-02 

0.684200 

0 . 81386bE-01 

100 

n  /. 

-0.013206 

0 . 174405E-03 

0.552615 

0. 236233E-01 

U  •  4 

0.082339 

0.677979E-02 

0.592910 

0 . 376335E-01 

250 

n  a 

-0.005406 

0 . 292295E-04 

0.492992 

0. 835025E-02 

U .  4 

0.097342 

0 . 947540E-02 

0.498336 

. 

0.988418E-02 

50 

2.8 

-0.037960 

0 . 144094E-02 

0.320511 

0.614737E-02 

0.066669 

0.444469E-02 

0.267973 

0. 171463E-01 

100 

2.8 

0.034567 

0 . 119485E-02 

0.341437 

0. 330387E-02 

0.030586 

0.935476E-03 

0.289064 

0 . 12067  5E-01 

250 

2.8 

-0.015350 

0 . 235616E-03 

0.356965 

0 . 175995E-02 

-0.005406 

0. 292295E-04 

0,335935 

0 . 396660E-02 
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Such  a  distribution  describes  the  failure  law  of  a  parallel  structure 
composed  of  two  independent  components  having  exponential  failure  distributions 
with  mean  lifetimes  h  and  1  . 


TABLE  2.3 


RADAR  TUBE  -  TYPE  1 


Data 

1.  n  -  19 

2.  Observed  Failure  Times  in  Hours 


533 
827 
877 
1007 
1271  | 
2394  | 
2741 
3244 
4130 
4368 
4744 
7253 
7705 
9482 
11813 
12317 
12563 
14977 
16713 


Estimates 


a  -  1/5  c  =  1/4 


c 

x  in  Hrs. 

a 
n 

;.f\) 

A 

in  Hrs. 

n 

r"(\) 

B 

527.45 

0.0 

0.3 

4130.01 

» 

0 . 102284E-03  j 

B 

516.35 

0.0 

0.4 

4368.08 

0. 111463E-03 

50 

505.25 

0.0 

0.5 

4368.08 

0. 115497E-03 

100 

477.51 

0.0 

0.6 

4368.08 

0. 132645E-03 

255.53 

0.0 

1 

0.7 

3244.04 

0. 134635E-03 

1000 

1826.02 

0.0 

0.8 

4130.01 

0.150098E-03  ^ 

1500 

5576.47 

0.0 

_2±j 

4368.08 

0.15°343E-Q3  j 

_ , 

x  »  5750  Hrs. 

g 


r 

g 


From  Figure  2.1 


0 . 250000E-04 


TABLE  2.4 


RADAR  TUBE  -  TYPE  2 


Data 

1.  n  -  25 

2.  Observed  Failure  Times  in  Hours 


44 

384 

548 

1172 

1373 

1527 

1611 

1614 

1634 

1873 

2249 

2892 

3100 

5160 

5468 

5531 

5809 

6631 

7368 

7511 

8611 

10847 

10920 

11546 

11567 


Estimates 

a  “  1/5  c  "  1/4 


c 

x  in  Hrs. 

a 

n 

M\) 

A 

x^  in  Hrs. 

n 

r°(\) 

10 

38.75 

0.0 

0.3 

3100.10 

0.157882E-03 

30 

28.24 

0.0 

0.4 

5809.10 

0.150124E-03 

50 

70.40 

0.0 

0.5 

1614.01 

0.162450E-03 

100 

96.66 

0.0 

0.6 

1614.01 

0.184687E-03 

500 

810.68 

0.0 

0.7 

3100.10 

0. 179432E-03 

1000 

3625.40 

0.0 

0.8 

2892.08 

0.183676E-03 

1500 

3880.05 

0.0  j 

0.9 

3100.10 

0.204013E-03 

From  Figure  2.1, 


x  -  4000  Hrs. 

8 

rg(xj  -  0, 145833E-04 


Tine  .  7 


THOUSANDS  Of  HOURS 


FIGURE  ?  . 


GRAPHICAL  ESTIMATION  OF  THE  CHANGE  POINT  AND 
FAILURE  PATE  FOR  TWO  TYPES  OF  RADAR  TUBES. 
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APPENDIX 

COMPUTER  PROGRAM 

A 

The  following  program,  written  in  FORTRAN  IV,  computes  x  and 

a 

n 

*  r  \  *  *!'■  \ 

rn(xa  )  ’  *b  an<*  I  ’  ^or  Probability  density  and  failure  rate 

functions,  under  the  assumption  of  complete  data.  The  program  comprises  of 
a  main  routine  and  four  subroutines  as  follows. 

Controls  the  over-all  computation  and  calculates  the  final 
results.  A  user  has  only  to  provide  the  input  data  specified 
by  this  routine. 

Sorts  the  failure  times  in  ascending  order. 

Computes  the  empirical  distribution  function. 

Computes  the  value  of  <p-  (x)  at  any  specified  point  x  . 

r 

n 

Computes  g|^G  for  i  -  0,1 . n  .  These  values  are 

necessary  to  calculate  <5>  (x)  . 

r 

n 

A  listing  of  the  program  is  given  on  the  following  pages  and,  for  each 
routine,  the  listing  includes  comments  regarding  the  pertinent  quantities 
used  by  that  routine. 


Main  Routine 

CPOINT  : 

Subroutines 

ORSTAT  : 
EMP  : 
GINVF  : 

GGINVF  : 
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RUN,S,»,,», 50000. 
LGO, 


C 

C 

C 

C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


1000 


PROGRAM  CPOINT < INPUT, OUTPUT) 

MAIN  ROUTINE  -  PROCESSES  THE  DATA  AND  OBTAINS  TWO 
ESTIMATES  OF  THE  CHANGE  POINT  AND  THE  VALUE  OF  THE 
generalized  FAILURE  RATE  FUNCTION  AT  THE  CHANGE  point. 

INPUT  REQUIRED  BY  THE  PROGRAM. 

N  =  NUMBER  OF  FAILURE  DATA. 

NF  -  NF  IS  EQUAL  TO  ZERO  IF  R(X)  IS  A  PROBABILITY 

DENSITY  FUNCTION  AND  EQUAL  TO  ONE  IF  R ( X  >  IS  A 
FAILURE  RATE  FUNCTION. 

NM  -  NM  IS  EQUAL  TO  ZERO  IF  THE  CHANGE  POINT  IS  THE 
MINIMIZING  POINT  AND  EQUAL  TO  ONE  IF  IT  IS  THE 
MAXIMIZING  POINT. 

XZERO  =  LEFT  HAND  END  POINT  OF  THE  SUPPORT  OF  F. 
N»NF,NM,XZEKO  SHOULD  BE  INPUT  ACCORDING  TO  FORMAT  1000. 
X(I),I  =  1 »N »  ARE  THE  N  FAILURE  TIMES.  THEY  SHOULD  BE 
READ  IN  ACCORDING  TO  FORMAT  1010. 

OUTPUT  FROM  THE  PROGRAM. 

X ( AN )  =  ESTIMATE  OF  THE  CHANGE  POINT  FROM  THE  LITTLE 
PHI  TRANSFORMATION. 

RIAN)  =  ESTIMATE  OF  THE  GENERALIZED  FAILURE  RATE 

FUNCTION  AT  THE  CHANGE  POINT  FROM  THE  LITTLE 
PHI  TRANSFORMATION. 

X(8N)  =  ESTIMATE  OF  THE  CHANGE  POINT  FROM  THE  CAPITAL 
PHI  TRANSFORMATION. 

R( BN)  =  ESTIMATE  OF  THE  GENERALIZED  FAILURE  RATE 

FUNCTION  AT  THE  CHANGE  POINT  FROM  THE  CAPITAL 
PHI  TRANSFORMATION. 

COMMON  N»FN»NF,NM,GGINVO»GGINV( 1000) . I N * X ( 1000) 

SPECIFY  A»ALPHA»C  -  CONSTANT  FOR  WINDOW, CL  -  CONSTANT 
FOR  GRID. 

A  *  0.5 
ALPHA  =  u.2 
C  *  10.0 
CL  =  0.25 

READ  1000»N»NF ,NM, XZERO 
FORMAT ( 1 4  » 2  1 1 *F20. 10 ) 

READ  1010, ( X<  I  )  »  1  =  1, N) 


1010  FORMAT ( 4F20 .8 ) 

FN  =  N 
CALL  ORSTaT 
CALL  GGINVF 
1  GRID  =  FN**(-ALPHA) 
AN  »  C*GRID 
BN  =  A*GRID 
GRID  =  CL*GRID 
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I ST1  =  1 
IST2  =  1 
IST3  =  1 
PEI  *  -l.o 
PE2  =  -l.o 
PE  =  -1.0 
P  =  X  C 1 ) -AN 
NCOUNT  =  1 

10  WMIN  =  P- AN 
WMAX  =  P+AN 
IN  =  IST1 

CALL  EMPC  WMIN  *  El ) 

I ST1  =  IN 
IN  =  I ST2 
CALL  EMP ( WMAX  *  E2  > 

IF  C PEI  .LT.  E 1 ) GO  TO  11 
IF  CPE2  .EQ.  E2 ) GO  TO  60 
GO  TO  12 

11  CALL  GINVF(EI.AI) 

12  IST2  =  IN 
PEI  =  El 
PE2  =  E2 

IF  ( £2  .LT.  1.0)G0  TO  20 
IF  ( NF  .EQ.  1 ) GO  TO  60 
20  CALL  GINVF ( E2  * A2 ) 

OF  =  A2-A1 

IF  INM  .EQ.  1)G0  TO  50 
IF  C NCOUNT  .EO.  1 ) GO  TO  30 
IF  (OF  .GE.  FR1)G0  TO  60 
30  FR1  «  OF 
CPI  =  P 
GO  TO  60 
40  INDEX  =  1 
GO  TO  110 

50  IF  (NCOUNT  .EQ,  1 ) GO  TO  30 
IF  tOF  .LE*  FR1 ) GO  TO  60 
GO  TO  30 
60  IN  =  I ST3 

CALL  EMP|P,E» 

IF  (PE  .EQ.  E ) GO  TO  110 
IST3  »  IN 
PE  *  E 

MIN  *  FN*( E-BN) 

IF  (MIN)40»70»7U 
70  MAX  *  FN*(E*8N)-1.0 

IF  (MAX  .GE.  N) GO  TO  110 
SUM  »  0.0 
DO  90  I  *  MIN.MAX 
IF  (I  .GT.  0 ) GO  TO  80 

SUM  *  SUM+GGI NVO# (X( 1)-XZER0) 

GO  TO  90 

80  SUM  *  SUM+GGINVI I )*( X( 1+1 ) -X ( I ) ) 
90  CONTINUE 
OF  *  SUM 

IF  CNM  .EQ.  1 )G0  TO  120 


I 


F  (NCOUNT 
F  ( INOEX  . 


1  )G0  TO 
1 )GO  TO  1 


4 


00 

0 


IF  (OF  .LE.  FR2 ) GO  TO  110 

100  FR2  =  OF 
CP2  =  P 
INDEX  =  0 

110  NCOUNT  *  NCOUNT+1 

111  IF  (E  .EQ.  1 • 0 ) GO  TO  130 
P  »  P+GR  I D 

IF  (E 2  .EQ.  1.0JGO  TO  60 
GO  TO  10 

120  IF  (NCOUNT  .EQ.  1 ) GO  TO  100 
IF  ( INDEX  .EQ.  l)GO  TO  100 
IF  (OF  .GE.  FR2JGO  TO  110 
GO  TO  10u 

130  FR1  =  FR1/(2.0*AN) 

IF  ( INDEX  .EQ.  1 )GO  TO  160 
IF  (FR2  .EQ.  0.u)G0  TO  140 
FR2  *  (2.0*BN)/FR2 
GO  TO  15u 

140  FR2  =  999999999.99999 

150  PRINT  1020,N.A.C.CPltFRl»CP2.FR2 
1020  FORMAT ( 4X »*N  =*»I4*3X.*A  =* » F5 .2 . 3X »*C  =*.F5.1»3X. 

1 * X ( AN )  =**E14.6»3X#*R( AN  >  =**E14.6*3X*»X(BN)  =*»E14. 
23X.*R(BN)  ** » E14.6 ) 

GO  TO  170 

160  A  *  A-0.05 

IF  (A  .GT.  O.OJGO  TO  1 
PRINT  1030tN.A.C»CPl»FRl 

1030  FORMAT ( 4X »*N  =*»l4»3Xt*A  =*»F5.2 .3X.*C  =**F5.1*3Xt 
1*X ( AN )  =*»E14.6t3X»*R(AN)  =*»E14.6»3X» 

2*DECREASE  A  BY  A  SMALLER  AMOUNT  IN  STATEMENT  160*) 

170  STOP 
END 


yj  v  u  u  u  u  u 
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SUBROUTINE  ORSTAT 

SORTS  THE  FAILURE  TIMES  IN  ASCENDING  ORDER  TO  OBTAIN 
ORDER  STATISTICS. 

COMMON  N»FN*NF»NM*GGINV0#GGINV( 1000) * IN*X( 1000) 

NN  *  N-l 
10  IND  =  0 

DO  20  I  =  l.NN 
J  =  1  +  1 

IF  mil  .LE.  X(  J))GO  TO  20 
S  «  X<  1 ) 

X  ( 2  )  =  X  (  J  ) 

X(J)  =  s 
IND  =  I 
20  CONTINUE 
NN  =  IND-1 

IF  (IND  .GE.  2 ) GO  TO  10 

RETURN 

END 


SUBROUTINE  EMP(XX*FNX) 

F NX  =  VALUE  OF  THE  EMPIRICAL  DISTRIBUTION  FUNCTION  AT 
XX. 

COMMON  N»FN»NF,NM.GGINVO»GGINVI 1000) tIN*Xl 1000) 

DO  10  I  =  IN.N 
IF  (XX  .LT.  X ( I ) )GO  TO  20 
10  CONTINUE 
FI  «  FN 
GO  TO  40 

20  IF  (I  .GT.  1 ) GO  TO  30 
FI  »  I 
FNX  •  0.0 
GO  TO  50 
30  FI  •  1-1 
40  FNX  *  FI/FN 
50  IN  »  FI 
RETURN 
END 


V  VU  u  KJ  \J 


SUBROUTINE  GINVFIY. VALUE) 

VALUE  =  GINVERSE  FUNCTION  COMPUTED  AT  Y. 

COMMON  N*FN*NF  .NM . GGI NVO . GGI NV ( 1 000) ♦ IN.XC 1000) 
IF  INF  .EQ.  1 )G0  TO  10 
VALUE  =  Y 
GO  TO  20 

10  VALUE  =  -ALOG(l.O-Y) 

20  RETURN 
END 


SUBROUTINE  GGINVF 

COMPUTES  THE  GGINVERSE  FUNCTION. 

COMMON  N*FN*NF.NM.GGINV0»GGINV( 1000) . I N *X ( 1000) 
•  IF  INF  ,EO.  1)G0  TO  20 
DO  10  I  =1.N 
GGINV(I)  =  1.0 
10  CONTINUE 
GO  TO  40 

20  DO  30  I  «  ltN 
F  =  I 

GGINV(I)  =  CFN-F)/FN 
30  CONTINUE 
<♦  J  GGINVO  =  1.0 
RETURN 
END 
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